00010000:00010000:1.0F:1767317498.724842:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317499.746216:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317500.769576:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1767317501.794300:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1767317502.497178:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291647232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.497319:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.497347:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.497393:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317502.497399:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.497418:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.516266:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.516290:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.516302:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291647232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.516314:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317502.516326:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291647744:192.168.202.133@tcp:400:kworker.0 00010000:00010000:0.0:1767317502.817021:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0F:1767317503.708800:0:81454:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 211: mirror delete should not cause bad size ========================================================== 20:31:42 (1767317502) 00000080:00200000:2.0:1767317503.780051:0:81457:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317503.780095:0:81457:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317503.780120:0:81457:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.784584:0:81457:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317503.784616:0:81457:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317503.784634:0:81457:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317503.784639:0:81457:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cef6 00000080:00010000:2.0:1767317503.784650:0:81457:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cef6 from it ffffa7f7c0c8fbf8 00010000:00010000:2.0:1767317503.784655:0:81457:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.784665:0:81457:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317503.784687:0:81457:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317503.784723:0:81457:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317503.784747:0:81457:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317503.784763:0:81457:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.784774:0:81457:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317503.784780:0:81457:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317503.784785:0:81457:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317503.784805:0:81457:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cef6 00000080:00010000:2.0:1767317503.784810:0:81457:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cef6 from it ffffa7f7c0c8fb38 00010000:00010000:2.0:1767317503.784814:0:81457:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.784821:0:81457:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317503.784830:0:81457:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317503.784836:0:81457:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43b8d500, open_flags c241, mode 81b6 opened 0 00000080:00200000:2.0:1767317503.784846:0:81457:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:2.0:1767317503.784891:0:81457:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0141102 00010000:00010000:2.0:1767317503.784906:0:81457:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.784992:0:81457:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.785000:0:81457:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317503.785004:0:81457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442cef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7160a expref: -99 pid: 80407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317503.785046:0:81457:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81457 initiator: MDT0 00010000:00010000:2.0:1767317503.785053:0:81457:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81457 initiator: MDT0 00000020:00100000:2.0:1767317503.785068:0:81457:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317503.785084:0:81457:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39880 x1853164291648000/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317503.785101:0:81457:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81457 initiator: MDT0 00000100:00100000:2.0:1767317503.785128:0:81457:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81457:1853164291648000:192.168.202.133@tcp:101:dd.0 00000100:00100000:2.0:1767317503.785333:0:81457:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b840 going to sleep for 12 seconds 00000100:00100000:3.0:1767317503.805943:0:81457:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81457:1853164291648000:192.168.202.133@tcp:101:dd.0 00010000:00010000:3.0:1767317503.805976:0:81457:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806010:0:81457:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806020:0:81457:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806035:0:81457:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806063:0:81457:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806078:0:81457:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806087:0:81457:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317503.806094:0:81457:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317503.806107:0:81457:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8c3c46a39880 x1853164291648000/t8589937199(8589937199) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/664 e 0 to 0 dl 1767317520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317503.806121:0:81457:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39880 x1853164291648000/t8589937199(8589937199) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/664 e 0 to 0 dl 1767317520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317503.806135:0:81457:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317503.806149:0:81457:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317503.806161:0:81457:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:3.0:1767317503.806180:0:81457:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317503.806197:0:81457:0:(namei.c:1569:ll_create_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000080:00200000:3.0:1767317503.806229:0:81457:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00200000:3.0:1767317503.806326:0:81457:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1767317503.806338:0:81457:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:3.0:1767317503.806342:0:81457:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf04 00000080:00010000:3.0:1767317503.806355:0:81457:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00200008:3.0:1767317503.806373:0:81457:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 141101 00000002:00100000:3.0:1767317503.806398:0:81457:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39880 x1853164291648000/t8589937199(8589937199) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/664 e 0 to 0 dl 1767317520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1767317503.806440:0:81457:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf04 from it ffff8c3c600450c0 00010000:00010000:3.0:1767317503.806445:0:81457:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317503.806454:0:81457:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317503.806491:0:81457:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 40 00000080:00200008:3.0:1767317503.806608:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767317503.806617:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1767317503.806629:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767317503.806639:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:3.0:1767317503.806641:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:3.0:1767317503.806647:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767317503.806665:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317503.806674:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1767317503.806679:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317503.806698:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767317503.806713:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:3.0:1767317503.806718:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412eceb0, osc lock ffff8c3c60cb5db0, flags 0x0 00000080:00200000:3.0:1767317503.806728:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:3.0:1767317503.806742:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767317503.806803:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317503.806806:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:3.0:1767317503.806820:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:3.0:1767317503.806824:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.806827:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412eceb0 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.806831:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317503.806833:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412eceb0 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317503.806841:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767317503.806848:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317503.806946:0:76384:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497ba540 00000008:00100000:3.0:1767317503.807058:0:76384:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc2a00 - object 0x280000400:159 offset 0<>4096 00000100:00100000:3.0:1767317503.807097:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317503.807115:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648128:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317503.818199:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875979 gen 2 00000008:00010000:3.0:1767317503.818252:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497ba540 00000020:00200000:3.0:1767317503.818260:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.818285:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.818304:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497ba540 00000100:00100000:3.0:1767317503.818332:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648128:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317503.819614:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317503.819646:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317503.819653:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317503.819672:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:2.0:1767317503.819677:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317503.819690:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767317503.819728:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 4096 00000080:00200000:2.0:1767317503.819737:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 4096, bytes: 4096 00000080:00200000:2.0:1767317503.819751:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317503.819762:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317503.819764:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [4096, 8192) 0 0 00000080:00200000:2.0:1767317503.819769:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317503.819788:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [1, 1] 00020000:00200000:2.0:1767317503.819796:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 8192) 8192, 4096 00020000:00200000:2.0:1767317503.819801:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317503.819822:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [1, 1] 00000008:00010000:2.0:1767317503.819840:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767317503.819846:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c610057c0, flags 0x0 00000080:00200000:2.0:1767317503.819858:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [4096, 8192) append 0 append lockpos 0 00000080:00200000:2.0:1767317503.819899:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=4096=0x1000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317503.819966:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317503.819969:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 8192 00000020:00010000:2.0:1767317503.819979:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767317503.819983:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.819986:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.820009:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317503.820012:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317503.820021:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317503.820027:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317503.820049:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993ff00 00000008:00100000:2.0:1767317503.820162:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a38e00 - object 0x280000400:159 offset 4096<>8192 00000100:00100000:2.0:1767317503.820209:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317503.820231:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648256:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317503.837779:0:2520:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875980 gen 2 00000008:00010000:3.0:1767317503.837831:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993ff00 00000020:00200000:3.0:1767317503.837840:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.837851:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.837896:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993ff00 00000100:00100000:3.0:1767317503.837921:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648256:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317503.838287:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [1, 1] 00000080:00200000:2.0:1767317503.838304:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317503.838311:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317503.838328:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 8192 i_blocks 16 00000020:00200000:2.0:1767317503.838332:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317503.838342:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767317503.838374:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 8192, count: 4096 00000080:00200000:2.0:1767317503.838382:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 8192, bytes: 4096 00000080:00200000:2.0:1767317503.838392:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317503.838401:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317503.838404:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [8192, 12288) 0 0 00000080:00200000:2.0:1767317503.838408:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317503.838424:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [2, 2] 00020000:00200000:2.0:1767317503.838433:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 8192 chunk: [8192, 12288) 12288, 4096 00020000:00200000:2.0:1767317503.838437:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317503.838459:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [2, 2] 00000008:00010000:2.0:1767317503.838486:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767317503.838493:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c610057c0, flags 0x0 00000080:00200000:2.0:1767317503.838505:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [8192, 12288) append 0 append lockpos 0 00000080:00200000:2.0:1767317503.838521:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=8192=0x2000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317503.838575:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317503.838578:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 12288 00000020:00010000:2.0:1767317503.838588:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767317503.838597:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.838601:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.838604:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317503.838607:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317503.838615:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317503.838621:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317503.838636:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f780 00000008:00100000:2.0:1767317503.838734:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a39180 - object 0x280000400:159 offset 8192<>12288 00000100:00100000:3.0:1767317503.839666:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317503.839694:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648384:192.168.202.133@tcp:4:dd.0 00010000:00010000:0.0:1767317503.842028:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317503.874656:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875981 gen 2 00000008:00010000:3.0:1767317503.874701:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f780 00000020:00200000:3.0:1767317503.874720:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.874730:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.874750:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f780 00000100:00100000:3.0:1767317503.874779:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648384:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317503.875007:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [2, 2] 00000080:00200000:2.0:1767317503.875024:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317503.875030:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317503.875048:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 12288 i_blocks 24 00000020:00200000:2.0:1767317503.875052:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317503.875062:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767317503.875095:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 12288, count: 4096 00000080:00200000:2.0:1767317503.875103:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 12288, bytes: 4096 00000080:00200000:2.0:1767317503.875112:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317503.875123:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317503.875125:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [12288, 16384) 0 0 00000080:00200000:2.0:1767317503.875130:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317503.875159:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [3, 3] 00020000:00200000:2.0:1767317503.875168:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 12288 chunk: [12288, 16384) 16384, 4096 00020000:00200000:2.0:1767317503.875173:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317503.875194:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [3, 3] 00000008:00010000:2.0:1767317503.875213:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767317503.875219:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c610057c0, flags 0x0 00000080:00200000:2.0:1767317503.875233:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [12288, 16384) append 0 append lockpos 0 00000080:00200000:2.0:1767317503.875247:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=12288=0x3000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317503.875306:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317503.875309:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 16384 00000020:00010000:2.0:1767317503.875318:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767317503.875328:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.875332:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.875335:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317503.875338:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317503.875348:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317503.875354:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317503.875372:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f780 00000008:00100000:2.0:1767317503.875493:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3a680 - object 0x280000400:159 offset 12288<>16384 00000100:00100000:3.0:1767317503.875637:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317503.875654:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648512:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317503.933150:0:2520:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875982 gen 2 00000008:00010000:3.0:1767317503.933199:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f780 00000020:00200000:3.0:1767317503.933207:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.933219:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.933230:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f780 00000100:00100000:3.0:1767317503.933258:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648512:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317503.933473:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [3, 3] 00000080:00200000:2.0:1767317503.933499:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317503.933505:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317503.933521:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 16384 i_blocks 32 00000020:00200000:2.0:1767317503.933524:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317503.933534:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767317503.933572:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 16384, count: 4096 00000080:00200000:2.0:1767317503.933580:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 16384, bytes: 4096 00000080:00200000:2.0:1767317503.933590:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317503.933600:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317503.933602:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [16384, 20480) 0 0 00000080:00200000:2.0:1767317503.933607:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317503.933626:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [4, 4] 00020000:00200000:2.0:1767317503.933634:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 16384 chunk: [16384, 20480) 20480, 4096 00020000:00200000:2.0:1767317503.933639:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317503.933664:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [4, 4] 00000008:00010000:2.0:1767317503.933682:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767317503.933687:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c610057c0, flags 0x0 00000080:00200000:2.0:1767317503.933698:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [16384, 20480) append 0 append lockpos 0 00000080:00200000:2.0:1767317503.933712:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=16384=0x4000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317503.933762:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317503.933764:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 20480 00000020:00010000:2.0:1767317503.933772:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767317503.933787:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.933790:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.933794:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317503.933796:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317503.933804:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317503.933808:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317503.933834:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993ff00 00000008:00100000:2.0:1767317503.933973:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3b800 - object 0x280000400:159 offset 16384<>20480 00000100:00100000:3.0:1767317503.934461:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317503.934488:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648640:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317503.954072:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875983 gen 2 00000008:00010000:3.0:1767317503.954133:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993ff00 00000020:00200000:3.0:1767317503.954330:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.954341:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.954360:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993ff00 00000100:00100000:3.0:1767317503.954387:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648640:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317503.954800:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [4, 4] 00000080:00200000:2.0:1767317503.955131:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317503.955221:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317503.955239:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 20480 i_blocks 40 00000020:00200000:2.0:1767317503.955244:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317503.955255:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767317503.955354:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 20480, count: 4096 00000080:00200000:2.0:1767317503.955363:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 20480, bytes: 4096 00000080:00200000:2.0:1767317503.955373:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317503.955384:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317503.955387:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [20480, 24576) 0 0 00000080:00200000:2.0:1767317503.955392:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317503.955408:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [5, 5] 00020000:00200000:2.0:1767317503.955416:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 20480 chunk: [20480, 24576) 24576, 4096 00020000:00200000:2.0:1767317503.955421:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317503.955444:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [5, 5] 00000008:00010000:2.0:1767317503.955466:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767317503.955472:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c610057c0, flags 0x0 00000080:00200000:2.0:1767317503.955496:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [20480, 24576) append 0 append lockpos 0 00000080:00200000:2.0:1767317503.955513:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=20480=0x5000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317503.955569:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317503.955572:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 24576 00000020:00010000:2.0:1767317503.955583:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767317503.955595:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.955599:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317503.955603:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317503.955606:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317503.955614:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317503.955622:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317503.955650:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fa80 00000008:00100000:2.0:1767317503.955757:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3ad80 - object 0x280000400:159 offset 20480<>24576 00000100:00100000:3.0:1767317503.955839:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648768:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317503.974243:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875984 gen 2 00000008:00010000:3.0:1767317503.974310:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fa80 00000020:00200000:3.0:1767317503.974318:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317503.974330:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317503.974348:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fa80 00000100:00100000:3.0:1767317503.974389:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291648768:192.168.202.133@tcp:4:dd.0 00000080:00200000:3.0:1767317503.974934:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [5, 5] 00000080:00200000:3.0:1767317503.974953:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317503.974972:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767317503.974989:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 24576 i_blocks 48 00000020:00200000:3.0:1767317503.974993:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317503.975005:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:3.0:1767317503.975043:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 24576, count: 4096 00000080:00200000:3.0:1767317503.975051:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 24576, bytes: 4096 00000080:00200000:3.0:1767317503.975062:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767317503.975073:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:3.0:1767317503.975076:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [24576, 28672) 0 0 00000080:00200000:3.0:1767317503.975082:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767317503.975100:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [6, 6] 00020000:00200000:3.0:1767317503.975110:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 24576 chunk: [24576, 28672) 28672, 4096 00020000:00200000:3.0:1767317503.975117:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317503.975151:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [6, 6] 00000008:00010000:3.0:1767317503.975168:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:3.0:1767317503.975174:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecd30, osc lock ffff8c3c60cb5db0, flags 0x0 00000080:00200000:3.0:1767317503.975187:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [24576, 28672) append 0 append lockpos 0 00000080:00200000:3.0:1767317503.975204:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=24576=0x6000, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767317503.975264:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317503.975267:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 28672 00000020:00010000:3.0:1767317503.975440:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:3.0:1767317503.975444:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.975447:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecd30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.975451:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317503.975454:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecd30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317503.975464:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767317503.975470:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317503.975512:0:76384:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497ba540 00000008:00100000:3.0:1767317503.975628:0:76384:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc2a00 - object 0x280000400:159 offset 24576<>28672 00000100:00100000:3.0:1767317503.975676:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648896:192.168.202.133@tcp:4:dd.0 00000100:00100000:2.0:1767317503.984807:0:2520:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875985 gen 2 00000008:00010000:2.0:1767317503.985110:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497ba540 00000020:00200000:2.0:1767317503.985119:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317503.985132:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317503.985224:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497ba540 00000100:00100000:2.0:1767317503.985252:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291648896:192.168.202.133@tcp:4:dd.0 00000080:00200000:3.0:1767317503.985649:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [6, 6] 00000080:00200000:3.0:1767317503.985666:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317503.985672:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767317503.985689:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 28672 i_blocks 64 00000020:00200000:3.0:1767317503.985694:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317503.985704:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:3.0:1767317503.985742:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 28672, count: 4096 00000080:00200000:3.0:1767317503.985750:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 28672, bytes: 4096 00000080:00200000:3.0:1767317503.985762:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767317503.985771:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:3.0:1767317503.985774:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [28672, 32768) 0 0 00000080:00200000:3.0:1767317503.985778:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767317503.985796:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [7, 7] 00020000:00200000:3.0:1767317503.985804:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 28672 chunk: [28672, 32768) 32768, 4096 00020000:00200000:3.0:1767317503.985809:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317503.986079:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [7, 7] 00000008:00010000:3.0:1767317503.986101:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:3.0:1767317503.986107:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecd30, osc lock ffff8c3c60cb5db0, flags 0x0 00000080:00200000:3.0:1767317503.986119:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [28672, 32768) append 0 append lockpos 0 00000080:00200000:3.0:1767317503.986134:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=28672=0x7000, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767317503.989646:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317503.989651:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 32768 00000020:00010000:3.0:1767317503.989664:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_release():245 00000020:00010000:3.0:1767317503.989669:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.989673:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecd30 (ffff8c3c5a0847e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317503.989677:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61038 (ffff8c3c5a084c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317503.989679:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecd30 (ffff8c3c5a084c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317503.989697:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767317503.989705:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317503.989741:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bad80 00000008:00100000:3.0:1767317503.989857:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc3800 - object 0x280000400:159 offset 28672<>32768 00000100:00100000:3.0:1767317503.989929:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291649024:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317504.008952:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875986 gen 2 00000008:00010000:3.0:1767317504.009093:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bad80 00000020:00200000:3.0:1767317504.009101:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317504.009111:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317504.009189:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bad80 00000100:00100000:3.0:1767317504.009216:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291649024:192.168.202.133@tcp:4:dd.0 00000080:00200000:2.0:1767317504.009732:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [7, 7] 00000080:00200000:2.0:1767317504.009750:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317504.009756:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317504.009772:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 32768 i_blocks 72 00000020:00200000:2.0:1767317504.009776:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.009785:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:3.0:1767317504.013380:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 32768, count: 4096 00000080:00200000:3.0:1767317504.013405:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 32768, bytes: 4096 00000080:00200000:3.0:1767317504.013423:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767317504.013434:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:3.0:1767317504.013437:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [32768, 36864) 0 0 00000080:00200000:3.0:1767317504.013444:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767317504.013467:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [8, 8] 00020000:00200000:3.0:1767317504.013676:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 32768 chunk: [32768, 36864) 36864, 4096 00020000:00200000:3.0:1767317504.013683:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317504.013745:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [8, 8] 00000008:00010000:3.0:1767317504.013764:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:3.0:1767317504.013770:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecd30, osc lock ffff8c3c60cb5db0, flags 0x0 00000080:00200000:3.0:1767317504.013783:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [32768, 36864) append 0 append lockpos 0 00000080:00200000:3.0:1767317504.013806:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=32768=0x8000, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767317504.014732:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317504.014737:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 36864 00000020:00010000:3.0:1767317504.014749:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317504.014753:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.014769:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecd30 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.014773:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317504.014776:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecd30 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317504.014786:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767317504.014794:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317504.014846:0:76384:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bacc0 00000008:00100000:3.0:1767317504.015004:0:76384:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc3800 - object 0x280000400:159 offset 32768<>36864 00000100:00100000:3.0:1767317504.015055:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317504.015078:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291649152:192.168.202.133@tcp:4:dd.0 00000100:00100000:3.0:1767317504.022178:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875987 gen 2 00000008:00010000:3.0:1767317504.022230:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bacc0 00000020:00200000:3.0:1767317504.022240:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317504.022250:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317504.022266:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bacc0 00000100:00100000:3.0:1767317504.022302:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291649152:192.168.202.133@tcp:4:dd.0 00000080:00200000:0.0:1767317504.022464:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [8, 8] 00000080:00200000:0.0:1767317504.022488:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.022494:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:0.0:1767317504.022511:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 36864 i_blocks 80 00000020:00200000:0.0:1767317504.022515:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.022527:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:0.0:1767317504.022562:0:81457:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 36864, count: 4096 00000080:00200000:0.0:1767317504.022570:0:81457:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 36864, bytes: 4096 00000080:00200000:0.0:1767317504.022580:0:81457:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1767317504.022589:0:81457:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:0.0:1767317504.022592:0:81457:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [36864, 40960) 0 0 00000080:00200000:0.0:1767317504.022597:0:81457:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317504.022614:0:81457:0:(file.c:2072:ll_file_io_generic()) Range lock [9, 9] 00020000:00200000:0.0:1767317504.022624:0:81457:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 36864 chunk: [36864, 40960) 40960, 4096 00020000:00200000:0.0:1767317504.022628:0:81457:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.022649:0:81457:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [9, 9] 00000008:00010000:0.0:1767317504.022668:0:81457:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:0.0:1767317504.022673:0:81457:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287d30, osc lock ffff8c3c50c8f1d0, flags 0x0 00000080:00200000:0.0:1767317504.022686:0:81457:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [36864, 40960) append 0 append lockpos 0 00000080:00200000:0.0:1767317504.022700:0:81457:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=36864=0x9000, pages 1 (max 147456), lockless, parallel 00000020:00200000:0.0:1767317504.022758:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767317504.022761:0:81457:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 40960 00000020:00010000:0.0:1767317504.022770:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.022774:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.022777:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287d30 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.022781:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.022783:0:81457:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287d30 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.022791:0:81457:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1767317504.022798:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317504.022835:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e83c0 00000008:00100000:0.0:1767317504.022981:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9e300 - object 0x280000400:159 offset 36864<>40960 00000100:00100000:1.0:1767317504.023330:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291649280:192.168.202.133@tcp:4:dd.0 00000100:00100000:0.0:1767317504.035268:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875988 gen 2 00000008:00010000:0.0:1767317504.035321:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e83c0 00000020:00200000:0.0:1767317504.035330:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317504.035343:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317504.035401:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e83c0 00000100:00100000:0.0:1767317504.035431:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291649280:192.168.202.133@tcp:4:dd.0 00000080:00200000:3.0:1767317504.037086:0:81457:0:(file.c:2109:ll_file_io_generic()) Range unlock [9, 9] 00000080:00200000:3.0:1767317504.037112:0:81457:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317504.037119:0:81457:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767317504.037140:0:81457:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00200000:3.0:1767317504.037145:0:81457:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317504.037160:0:81457:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:3.0:1767317504.037228:0:81457:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 140001 00000002:00100000:3.0:1767317504.037328:0:81457:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a39880 x1853164291648000/t8589937199(8589937199) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/664 e 0 to 0 dl 1767317520 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317504.037343:0:81457:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317504.037349:0:81457:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3800 x1853164291649536/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317504.037380:0:81457:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81457:1853164291649536:192.168.202.133@tcp:35:dd.0 00000100:00100000:3.0:1767317504.037541:0:81457:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1767317504.040717:0:81457:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81457:1853164291649536:192.168.202.133@tcp:35:dd.0 00000002:00100000:3.0:1767317504.040763:0:81457:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a39880 x1853164291648000/t8589937199(8589937199) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/664 e 0 to 0 dl 1767317520 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317504.070385:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317504.070431:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317504.072387:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:2.0:1767317504.072407:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:2.0:1767317504.072420:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:2.0:1767317504.072487:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291649664:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317504.072678:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474bc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.081237:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291649664:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.081283:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081298:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081312:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081325:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081339:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081348:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081356:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.081394:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38a80 x1853164291649664/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.081412:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081437:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317504.081447:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.081491:0:81467:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317504.081500:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf0b 00000080:00010000:0.0:1767317504.081507:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.081510:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf0b from it ffffa7f7c1d6fbf8 00010000:00010000:0.0:1767317504.081514:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.081523:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.081553:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.081567:0:81467:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:0.0:1767317504.081576:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 44 00000080:00200008:0.0:1767317504.081586:0:81467:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154400 00000002:00010000:0.0:1767317504.081616:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767317504.081676:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:0.0:1767317504.081683:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000020:00100000:0.0:1767317504.081707:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317504.081714:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291649920/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317504.081723:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:0.0:1767317504.081748:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291649920:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.082706:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cacc0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.092106:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291649920:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.092151:0:81467:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.092164:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.092179:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.092192:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.092209:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317504.092223:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.092237:0:81467:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317504.092362:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.092375:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.092383:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.092531:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 0 -> 0 00000080:00010000:0.0:1767317504.092538:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf12 00000080:00010000:0.0:1767317504.092547:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf12 from it ffffa7f7c1d6fbf0 00010000:00010000:0.0:1767317504.092552:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.092563:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317504.092596:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317504.092813:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317504.092825:0:81467:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), xattr lov 00000080:00200008:0.0:1767317504.092858:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.092867:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.092937:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.092949:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.092975:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.092994:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.093002:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.093005:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf04 00000080:00010000:0.0:1767317504.093010:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf04 from it ffffa7f7c1d6fcd8 00010000:00010000:0.0:1767317504.093013:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.093021:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.093041:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767317504.093054:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.093079:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.093083:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287d30, osc lock ffff8c3c50c8f1d0, flags 0x400001002 00010000:00010000:0.0:1767317504.093147:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.093156:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.094741:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291650048:192.168.202.133@tcp:101:lfs.0 00000020:00200000:0.0:1767317504.095147:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.102974:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103010:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103029:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103045:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.103064:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.103078:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317504.103088:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103098:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103106:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.103135:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.103160:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291650048:192.168.202.133@tcp:101:lfs.0 00000080:00200000:0.0:1767317504.104932:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:0.0:1767317504.104946:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.104951:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.104957:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287d30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.104963:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.104966:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287d30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.105003:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.105077:0:81467:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154000 00010000:00010000:0.0:1767317504.105118:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.105247:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317504.105282:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.105294:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.105304:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.105312:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.105321:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.105325:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf0b 00000080:00010000:0.0:1767317504.105333:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf0b from it ffffa7f7c1d6fbf8 00010000:00010000:0.0:1767317504.105337:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.105346:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.105362:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.105370:0:81467:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:0.0:1767317504.105377:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 46 00000080:00200008:0.0:1767317504.105386:0:81467:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 1154402 00000002:00010000:0.0:1767317504.105403:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1767317504.105605:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:0.0:1767317504.105619:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000020:00100000:0.0:1767317504.105633:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317504.105646:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d500 x1853164291650304/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317504.105656:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:0.0:1767317504.105680:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650304:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.107620:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cacc0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.109713:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.109761:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379172480 00000100:00100000:3.0:1767317504.109772:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379172480 00000100:00100000:3.0:1767317504.109834:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9432 00000100:00100000:3.0:1767317504.109846:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172480:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.109893:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.109982:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.109990:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172480:12345-192.168.202.133@tcp:104: Request processed in 146us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.109998:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9432 00010000:00010000:0.0:1767317504.110062:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.110073:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110084:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.110091:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110102:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110113:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110145:0:63742:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110199:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110224:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.110254:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110262:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442cf04 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71649 expref: -99 pid: 81457 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.110281:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.110283:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.110285:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.110303:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291650432:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.114656:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291650432:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.117676:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650304:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.117714:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117736:0:81467:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117746:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117760:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117773:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117788:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117797:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117830:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.117843:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.117856:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.117894:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.117907:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.117915:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.117977:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf20 00000080:00010000:1.0:1767317504.117987:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf20 from it ffffa7f7c1d6fbf0 00010000:00010000:1.0:1767317504.117991:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.118000:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.118035:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767317504.118148:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=800466af arg=7ffc0e9d03ac 00000080:00200000:1.0:1767317504.118276:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.118296:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.118307:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.118327:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.118333:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.118339:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.118343:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf0b 00000080:00010000:1.0:1767317504.118348:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf0b from it ffffa7f7c1d6fbf8 00010000:00010000:1.0:1767317504.118351:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.118358:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.118366:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.118385:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.118391:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.118398:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.118405:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.118411:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.120356:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.120368:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf0b 00000080:00010000:1.0:1767317504.120381:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf0b from it ffffa7f7c1d6fb38 00010000:00010000:1.0:1767317504.120388:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.120608:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.120628:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317504.120639:0:81467:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=. :VOLATILE:0000:3420F956:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c5a1a9380, open_flags 2f9c1, mode 8180 opened 0 00000080:00200000:1.0:1767317504.120651:0:81467:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=. :VOLATILE:0000:3420F956:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:1.0:1767317504.120688:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: . :VOLATILE:0000:3420F956:fd=03,[0x200000405:0x8b:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0574702 00010000:00010000:1.0:1767317504.120708:0:81467:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.120780:0:81467:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.120788:0:81467:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.120790:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442cf0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a716a4 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.120836:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.120843:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000020:00100000:1.0:1767317504.120857:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.120984:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291650688/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.120996:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:1.0:1767317504.121032:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650688:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.121252:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a3c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.127333:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650688:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.127373:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127502:0:81467:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127513:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127526:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127539:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127553:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127561:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127570:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.127582:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.127614:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.127628:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.127639:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:1.0:1767317504.127648:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317504.127667:0:81467:0:(namei.c:1569:ll_create_it()) VFS Op:name=. :VOLATILE:0000:3420F956:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000080:00200000:1.0:1767317504.127778:0:81467:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08) 00000080:00200000:1.0:1767317504.127788:0:81467:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8b:0x0], updating i_size 0 00000080:00200000:1.0:1767317504.127834:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1767317504.127841:0:81467:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) 00000080:00010000:1.0:1767317504.127845:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) for lock 0x73c3d5cb1442cf27 00000080:00010000:1.0:1767317504.127857:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) 00000080:00200008:1.0:1767317504.127970:0:81467:0:(file.c:1001:ll_file_open()) START file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0](ffff8c3c61726c08), flags 574701 00000002:00100000:1.0:1767317504.128001:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317504.128046:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf27 from it ffff8c3c432f8a80 00010000:00010000:1.0:1767317504.128051:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.128061:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.128085:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08), inode mode 8180 mask 40 00000080:00200000:1.0:1767317504.128303:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08), inode mode 8180 mask 2 00000080:00200000:1.0:1767317504.128323:0:81467:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08), xattr lov 00000002:00010000:1.0:1767317504.128348:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:1.0:1767317504.128513:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.128524:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000020:00100000:1.0:1767317504.128540:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.128548:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291650944/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.128559:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:1.0:1767317504.128585:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650944:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.129699:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a3c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.136495:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.136706:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317504.136731:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379172608 00000100:00100000:2.0:1767317504.136742:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379172608 00000100:00100000:2.0:1767317504.136809:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9433 00000100:00100000:2.0:1767317504.136821:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c6d39a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172608:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.136845:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.137403:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.137422:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c6d39a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172608:12345-192.168.202.133@tcp:104: Request processed in 594us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.137431:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9433 00010000:00010000:0.0:1767317504.138244:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.138257:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138270:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.138275:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138285:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138294:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.138328:0:63276:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.138411:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138492:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317504.138562:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291651072:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317504.138827:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138836:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cf27 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716e3 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.138858:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.138860:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.138862:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317504.142519:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291651072:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.143402:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291650944:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.143438:0:81467:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143455:0:81467:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143463:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143471:0:81467:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143511:0:81467:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143518:0:81467:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317504.143524:0:81467:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143532:0:81467:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143542:0:81467:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143549:0:81467:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317504.143558:0:81467:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.143566:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 81467 initiator: MDT0 00000002:00100000:1.0:1767317504.143598:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8c3c437c1180 x1853164291650944/t8589937205(8589937205) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.143614:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291650944/t8589937205(8589937205) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317504.143636:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317504.143689:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317504.143700:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.143752:0:81467:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8b:0x0], updating i_size 0 00000002:00100000:1.0:1767317504.143775:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291650944/t8589937205(8589937205) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.143834:0:81467:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1180 x1853164291650944/t8589937205(8589937205) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.143846:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.143851:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3b80 x1853164291651328/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.143939:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651328:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.144047:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.147060:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651328:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.147105:0:81467:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1180 x1853164291650944/t8589937205(8589937205) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317521 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317504.147171:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.147181:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.147201:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.147220:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:1.0:1767317504.147280:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.147289:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.147300:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:1.0:1767317504.147322:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651456:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.147434:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.157317:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.157555:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379172736 00000100:00100000:2.0:1767317504.157569:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379172736 00000100:00100000:2.0:1767317504.157674:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9434 00000100:00100000:2.0:1767317504.157686:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172736:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.157708:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.157812:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.157820:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379172736:12345-192.168.202.133@tcp:104: Request processed in 136us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.157828:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9434 00010000:00010000:1.0:1767317504.157895:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.157904:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.157913:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317504.157919:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.157929:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.157938:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.157987:0:63490:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.158036:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.158043:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.158082:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.158089:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cf20 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a716ce expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.158106:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.158108:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.158110:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317504.158120:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317504.158164:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291651584:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317504.163463:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651456:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317504.163508:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163524:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163539:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163575:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163590:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163599:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.163606:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317504.163618:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291651456/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317504.163631:0:81467:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317504.163645:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.163660:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:3.0:1767317504.163668:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317504.163744:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 0 -> 0 00000080:00010000:3.0:1767317504.163750:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf35 00000080:00010000:3.0:1767317504.163756:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:3.0:1767317504.163760:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf35 from it ffffa7f7c1d6fcd8 00010000:00010000:3.0:1767317504.163763:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.163777:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317504.163819:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1767317504.163830:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:3.0:1767317504.163851:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317504.163855:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecd30, osc lock ffff8c3c60cb5db0, flags 0x400001002 00010000:00010000:3.0:1767317504.163892:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.163907:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317504.163921:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317504.163924:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.163932:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317504.163945:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317504.163956:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:3.0:1767317504.163961:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317504.163975:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.163978:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecd30 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.163982:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317504.163985:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecd30 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317504.164001:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317504.164025:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0](ffff8c3c61726c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317504.164034:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08),name=. :VOLATILE:0000:3420F956:fd=03 00000002:00010000:3.0:1767317504.164054:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000405:0x8b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317504.164109:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:3.0:1767317504.164116:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:3.0:1767317504.164126:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:3.0:1767317504.164506:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651712:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317504.164628:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0d80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.166072:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291651584:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317504.171604:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291651712:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317504.171640:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171655:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171668:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171680:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171694:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171723:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317504.171730:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317504.171743:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc0700 x1853164291651712/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/720 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317504.171757:0:81467:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317504.171772:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.171787:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:3.0:1767317504.171795:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8b:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317504.171859:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:3.0:1767317504.171865:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) for lock 0x73c3d5cb1442cf3c 00000080:00010000:3.0:1767317504.171917:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) 00000080:00010000:3.0:1767317504.171921:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf3c from it ffffa7f7c1d6fcd8 00010000:00010000:3.0:1767317504.171924:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.171933:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317504.172324:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767317504.173106:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8b:0x0] 00000008:00010000:2.0:1767317504.173153:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317504.173158:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511792b0, osc lock ffff8c3c610057c0, flags 0x400001002 00010000:00010000:2.0:1767317504.173410:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.173424:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.173491:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1767317504.173505:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317504.173532:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291651840:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317504.176172:0:2520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176206:0:2520:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176225:0:2520:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176238:0:2520:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317504.176257:0:2520:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317504.176279:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1767317504.176299:0:2520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176308:0:2520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176316:0:2520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.176324:0:2520:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767317504.176370:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291651840:192.168.202.133@tcp:101:lfs.0 00000080:00200000:1.0:1767317504.176693:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767317504.176700:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.176704:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.176711:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511792b0 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.176715:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.176718:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511792b0 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.176733:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/1, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767317504.176767:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=7ffc0e9d24f4 00000002:00010000:1.0:1767317504.176803:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767317504.176925:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.176934:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000020:00100000:1.0:1767317504.176948:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.176959:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291652096/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.176970:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 81467 initiator: MDT0 00000100:00100000:1.0:1767317504.176995:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652096:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.180558:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.180744:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652096:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.180774:0:81467:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180788:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180803:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180817:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180832:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180864:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180893:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.180906:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317504.180920:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.180936:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.180951:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.180959:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317504.180982:0:81467:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317504.180991:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf4a 00000080:00010000:0.0:1767317504.180998:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf4a from it ffffa7f7c1d6fcc0 00010000:00010000:0.0:1767317504.181001:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.181008:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317504.181085:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.181100:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.181119:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.181128:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.181140:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.181148:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.181155:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.181159:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf35 00000080:00010000:0.0:1767317504.181164:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf35 from it ffffa7f7c1d6fcd8 00010000:00010000:0.0:1767317504.181167:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.181175:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.181218:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767317504.181233:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.181256:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.181260:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287d30, osc lock ffff8c3c50c8f1d0, flags 0x400001002 00010000:00010000:0.0:1767317504.185186:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.185993:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.186014:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.186046:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.186057:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.186079:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.186099:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:0.0:1767317504.186106:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.186110:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.186116:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287d30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.186121:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.186124:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287d30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.186159:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.186188:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.186197:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.186235:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.186251:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.186262:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.186279:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.186289:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.186294:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf35 00000080:00010000:0.0:1767317504.186301:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf35 from it ffffa7f7c1d6fcd8 00010000:00010000:0.0:1767317504.186305:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.186319:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.186342:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767317504.186352:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.186372:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.186376:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287d30, osc lock ffff8c3c50c8f1d0, flags 0x400001002 00010000:00010000:0.0:1767317504.186390:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.186400:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.186408:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.186412:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.186420:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.186429:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.186434:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:0.0:1767317504.186437:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.186439:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.186442:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287d30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.186445:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.186448:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287d30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.186460:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1767317504.186483:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=801066da arg=7ffc0e9d23f0 00000080:00200000:0.0:1767317504.186494:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.186503:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767317504.186612:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.186641:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291652224:192.168.202.133@tcp:1:lfs.0 00000100:00100000:0.0:1767317504.190807:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291652224:192.168.202.133@tcp:1:lfs.0 00000080:00200000:2.0:1767317504.191091:0:81467:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 4 00000080:00200000:2.0:1767317504.191105:0:81467:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), xattr lov 00000080:00200008:2.0:1767317504.193521:0:81467:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317504.193541:0:81467:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:2.0:1767317504.193573:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317504.193593:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.193607:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.193614:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317504.193624:0:81467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:2.0:1767317504.193628:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf35 00000080:00010000:2.0:1767317504.193635:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf35 from it ffffa7f7c1d6fcd8 00010000:00010000:2.0:1767317504.193638:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.193666:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.193701:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767317504.193714:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767317504.193738:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317504.193741:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179f30, osc lock ffff8c3c61004260, flags 0x400001002 00010000:00010000:2.0:1767317504.193758:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.193766:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.193776:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317504.193780:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.193785:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.193793:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.193802:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:2.0:1767317504.193806:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.193808:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.193809:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179f30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.193812:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.193815:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179f30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.193832:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317504.270855:0:81467:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1767317504.270902:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1767317504.270914:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:3.0:1767317504.270941:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317504.270954:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec2b0, osc lock ffff8c3c60cb5db0, flags 0x400001002 00010000:00010000:3.0:1767317504.270979:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.270998:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317504.271012:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317504.271016:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.271026:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317504.271042:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317504.271053:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:3.0:1767317504.271613:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:3.0:1767317504.271617:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.271620:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec2b0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317504.271624:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317504.271627:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec2b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317504.271654:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317504.271666:0:81467:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null), rc = 40960 00000080:00200008:3.0:1767317504.271674:0:81467:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:3.0:1767317504.271679:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317504.271686:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317504.271704:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000080:00200000:3.0:1767317504.271713:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317504.271718:0:81467:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1767317504.271720:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317504.271725:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317504.271729:0:81467:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767317504.271736:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767317504.271738:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec2b0, osc lock ffff8c3c60cb5db0, flags 0x0 00010000:00010000:3.0:1767317504.271750:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.271762:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.271771:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.271778:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.271785:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317504.271805:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000100:00100000:3.0:1767317504.271923:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317504.272025:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291652352:192.168.202.133@tcp:23:lfs.0 00000100:00100000:2.0:1767317504.277019:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291652352:192.168.202.133@tcp:23:lfs.0 00000020:00010000:0.0:1767317504.277163:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.277169:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.277175:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec2b0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767317504.277188:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.277206:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767317504.277228:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.277231:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec2b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.277253:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.277284:0:81467:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE, rc = 40960 00000080:00200080:0.0:1767317504.277322:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=66f4 arg=969 00000080:00200008:0.0:1767317504.277345:0:81467:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 67108864 00000080:00200000:0.0:1767317504.277355:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317504.277371:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.277377:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767317504.277383:0:81467:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.277761:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.277768:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287d30, osc lock ffff8c3c50c8f1d0, flags 0x400001002 00010000:00010000:0.0:1767317504.277794:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.277810:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.277827:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.277832:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.277840:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.277849:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.277858:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:0.0:1767317504.277861:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.277864:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.277867:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287d30 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.277918:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.277921:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287d30 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.277929:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.277935:0:81467:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 67108864] over eof, kms 40960, file_size 40960. 00000080:00200000:0.0:1767317504.277946:0:81467:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 40960 00000080:00200000:0.0:1767317504.277955:0:81467:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1767317504.277964:0:81467:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:0.0:1767317504.277966:0:81467:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 40960) 2048 0 00000080:00200000:0.0:1767317504.277976:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317504.277987:0:81467:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:0.0:1767317504.277995:0:81467:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 40960) 40960, 40960 00020000:00200000:0.0:1767317504.278000:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.278013:0:81467:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 9] 00000008:00010000:1.0:1767317504.278142:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317504.278147:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c83b0, osc lock ffff8c3c60dd0980, flags 0x40000 00000080:00200000:1.0:1767317504.278155:0:81467:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 40960) 00000080:00200000:1.0:1767317504.278170:0:81467:0:(vvp_io.c:886:vvp_io_read_start()) count:40960 iocb pos:0 00000080:00200000:1.0:1767317504.278178:0:81467:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=40960 (max 603979776), offset=0=0x0, pages 10 (max 147456), lockless, parallel 00000020:00200000:1.0:1767317504.278264:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 10 items remaining. 00000080:00200000:1.0:1767317504.278267:0:81467:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 40960 count 40960 file_offset 40960 00000020:00010000:1.0:1767317504.278273:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.278276:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.278278:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c83b0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.278281:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.278284:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c83b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.278290:0:81467:0:(vvp_io.c:518:vvp_io_advance()) advancing 40960 bytes 00000020:00200000:1.0:1767317504.278295:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317504.278315:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319a80 00000008:00100000:1.0:1767317504.278381:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c3100 - object 0x280000400:159 offset 0<>40960 00000100:00100000:1.0:1767317504.278433:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317504.278454:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291652480:192.168.202.133@tcp:3:lfs.0 00000008:00010000:1.0:1767317504.300932:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319a80 00000020:00200000:1.0:1767317504.300950:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 9 items remaining. 00000020:00200000:1.0:1767317504.300954:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 8 items remaining. 00000020:00200000:1.0:1767317504.300956:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 7 items remaining. 00000020:00200000:1.0:1767317504.300958:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 6 items remaining. 00000020:00200000:1.0:1767317504.300960:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 5 items remaining. 00000020:00200000:1.0:1767317504.300962:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 4 items remaining. 00000020:00200000:1.0:1767317504.300964:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 3 items remaining. 00000020:00200000:1.0:1767317504.300966:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000020:00200000:1.0:1767317504.300967:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000020:00200000:1.0:1767317504.300969:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767317504.300980:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767317504.301004:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319a80 00000100:00100000:1.0:1767317504.301034:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291652480:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317504.301159:0:81467:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:2.0:1767317504.301188:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317504.301195:0:81467:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 40960, restart: 0 00000020:00200000:2.0:1767317504.301198:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.301210:0:81467:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 40960 00000080:00200008:2.0:1767317504.301246:0:81467:0:(file.c:2648:do_file_write_iter()) START file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0], ppos: 0, count: 40960 00000080:00200000:2.0:1767317504.301254:0:81467:0:(file.c:1994:ll_file_io_generic()) . :VOLATILE:0000:3420F956:fd=03: write ppos: 0, bytes: 40960 00000080:00200000:2.0:1767317504.301273:0:81467:0:(file.c:1759:ll_io_set_mirror()) . :VOLATILE:0000:3420F956:fd=03: desiginated mirror: 0 00000020:00200000:2.0:1767317504.301283:0:81467:0:(cl_io.c:214:cl_io_rw_init()) header@000000006e5632dc[0x4, 2, [0x200000405:0x8b:0x0] hash] 00000020:00200000:2.0:1767317504.301286:0:81467:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 40960) 2048 0 00000080:00200000:2.0:1767317504.301290:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317504.301308:0:81467:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:2.0:1767317504.301317:0:81467:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 40960) 40960, 40960 00020000:00200000:2.0:1767317504.301322:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317504.301345:0:81467:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:2.0:1767317504.301363:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317504.301369:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179f30, osc lock ffff8c3c61004260, flags 0x40000 00000080:00200000:2.0:1767317504.301382:0:81467:0:(vvp_io.c:1312:vvp_io_write_start()) . :VOLATILE:0000:3420F956:fd=03: write [0, 40960) append 0 append lockpos 0 00000002:00010000:2.0:1767317504.301439:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8b:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1767317504.301515:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:2.0:1767317504.301791:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:2.0:1767317504.301804:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:2.0:1767317504.301833:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652608:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317504.302019:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b600 going to sleep for 12 seconds 00000100:00100000:2.0:1767317504.305643:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652608:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317504.305675:0:81467:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.305694:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.305705:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317504.305720:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff8c3c46a3b100 x1853164291652608/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 568/1152 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317504.305732:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.305748:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:2.0:1767317504.305757:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8b:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1767317504.305786:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) for lock 0x73c3d5cb1442cf51 00000080:00010000:2.0:1767317504.305797:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf51 from it ffffa7f7c1d6f8f8 00010000:00010000:2.0:1767317504.305801:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.305810:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317504.305862:0:81467:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08), size=40960 (max 603979776), offset=0=0x0, pages 10 (max 147456), lockless, parallel 00000020:00200000:0.0:1767317504.311514:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 10 items remaining. 00000080:00200000:0.0:1767317504.311528:0:81467:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 40960 count 40960 file_offset 40960 00000080:00200000:0.0:1767317504.311554:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1767317504.311563:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.311568:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.311572:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179f30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.311576:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.311580:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179f30 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.311596:0:81467:0:(vvp_io.c:518:vvp_io_advance()) advancing 40960 bytes 00000020:00200000:0.0:1767317504.311605:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317504.311632:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e83c0 00000008:00100000:0.0:1767317504.311778:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9c700 - object 0x2c0000400:191 offset 0<>40960 00000100:00100000:0.0:1767317504.311832:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.311860:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291652736:192.168.202.133@tcp:4:lfs.0 00000100:00100000:3.0:1767317504.324707:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.324825:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379172864 00000100:00100000:2.0:1767317504.324856:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379172864 00000100:00100000:2.0:1767317504.324960:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9435 00000100:00100000:2.0:1767317504.324984:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379172864:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.325007:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.325104:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.325113:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379172864:12345-192.168.202.133@tcp:104: Request processed in 132us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.325120:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9435 00010000:00010000:2.0:1767317504.325158:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767317504.325165:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.325174:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:2.0:1767317504.325181:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317504.325215:0:63743:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767317504.325232:0:63743:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767317504.325282:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.325291:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317504.325316:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.325325:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442cf43 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71722 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.325357:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317504.325359:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317504.325360:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317504.325380:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291652864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317504.330059:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291652864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.335809:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805036 gen 3 00000008:00010000:1.0:1767317504.336043:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e83c0 00000020:00200000:1.0:1767317504.336051:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 9 items remaining. 00000020:00200000:1.0:1767317504.336053:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 8 items remaining. 00000020:00200000:1.0:1767317504.336055:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 7 items remaining. 00000020:00200000:1.0:1767317504.336056:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 6 items remaining. 00000020:00200000:1.0:1767317504.336057:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 5 items remaining. 00000020:00200000:1.0:1767317504.336059:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 4 items remaining. 00000020:00200000:1.0:1767317504.336060:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 3 items remaining. 00000020:00200000:1.0:1767317504.336061:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000020:00200000:1.0:1767317504.336062:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000020:00200000:1.0:1767317504.336063:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767317504.336071:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767317504.336160:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e83c0 00000100:00100000:1.0:1767317504.336210:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291652736:192.168.202.133@tcp:4:lfs.0 00000080:00200000:2.0:1767317504.337527:0:81467:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:2.0:1767317504.337549:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317504.337556:0:81467:0:(file.c:2142:ll_file_io_generic()) . :VOLATILE:0000:3420F956:fd=03: 2 io complete with rc: 0, result: 40960, restart: 0 00000080:00200000:2.0:1767317504.337577:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 40960 i_blocks 80 00000020:00200000:2.0:1767317504.337582:0:81467:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.337594:0:81467:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 40960 00000080:00200000:2.0:1767317504.337623:0:81467:0:(file.c:5319:ll_fsync()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff8c3c61726c08), start 0, end 9223372036854775807, datasync 0 00000100:00100000:2.0:1767317504.337693:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652992:192.168.202.133@tcp:44:lfs.0 00000100:00100000:2.0:1767317504.337800:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b300 going to sleep for 12 seconds 00000100:00100000:2.0:1767317504.342768:0:81467:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937207 gen 1 00000100:00100000:2.0:1767317504.342825:0:81467:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767317504.342839:0:81467:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767317504.342849:0:81467:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767317504.342978:0:81467:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767317504.343011:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291652992:192.168.202.133@tcp:44:lfs.0 00000080:00200000:2.0:1767317504.343039:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 1 restore needed 0 00020000:00200000:2.0:1767317504.343056:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:2.0:1767317504.343294:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317504.343315:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291653120:192.168.202.133@tcp:16:lfs.0 00000100:00100000:2.0:1767317504.346681:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291653120:192.168.202.133@tcp:16:lfs.0 00000080:00200000:1.0:1767317504.346804:0:81467:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 40960 i_blocks 80 00000080:00200000:1.0:1767317504.346826:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767317504.358645:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=801066da arg=7ffc0e9d23f0 00000080:00200000:1.0:1767317504.358678:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.358695:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767317504.358837:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317504.358867:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291653248:192.168.202.133@tcp:1:lfs.0 00000100:00100000:1.0:1767317504.362801:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291653248:192.168.202.133@tcp:1:lfs.0 00000080:00200008:0.0:1767317504.362979:0:81467:0:(llite_lib.c:2314:ll_setattr_raw()) START file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0](ffff8c3c61726c08) current size 40960, valid attrs 101f0, mode 8c3c, uid 6804, gid 4, new size 4294967296, atime 1767317503.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000 00010000:00010000:0.0:1767317504.363031:0:81467:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.363058:0:81467:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.363115:0:81467:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.363122:0:81467:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.363126:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442cf3c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7171b expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317504.363194:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317504.363213:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291653504/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317504.363242:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653504:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317504.363345:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.366728:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653504:192.168.202.133@tcp:36:lfs.0 00000080:00200000:0.0:1767317504.366789:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1767317504.366813:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/139 (0 0) 00000080:00010000:0.0:1767317504.366828:0:81467:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8b:0x0](ffff8c3c61726c08) 00000002:00010000:0.0:1767317504.366842:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000405:0x8b:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317504.366940:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:0.0:1767317504.366950:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:0.0:1767317504.366970:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:0.0:1767317504.366994:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653632:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.367094:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.370546:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653632:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.370587:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.370605:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317504.370639:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9d880 x1853164291653632/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/480 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.370651:0:81467:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317504.370766:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.370783:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/139 (0 0) 00000080:00200000:1.0:1767317504.370791:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8b:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.370812:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff8c3c61726c08) for lock 0x73c3d5cb1442cf58 00000080:00010000:1.0:1767317504.370829:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf58 from it ffffa7f7c1d6fa78 00010000:00010000:1.0:1767317504.370834:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.370843:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.370941:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.370955:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.371055:0:81467:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8b:0x0](00000000f7572370) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.371107:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 1 00010000:00010000:1.0:1767317504.371113:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.371121:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00020000:00200000:1.0:1767317504.371342:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.371361:0:81467:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317504.371378:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317504.371383:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c83b0, osc lock ffff8c3c60dd0980, flags 0x0 00010000:00010000:1.0:1767317504.371449:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.371457:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.371487:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.371516:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653760:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.371699:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.375403:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291653760:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.375451:0:81467:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.375470:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.375499:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.375514:0:81467:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.375528:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.375537:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317504.375666:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291653888:192.168.202.133@tcp:2:lfs.0 00000100:00100000:1.0:1767317504.379463:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291653888:192.168.202.133@tcp:2:lfs.0 00000020:00010000:2.0:1767317504.379580:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.379586:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.379592:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c83b0 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317504.379606:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.379620:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317504.379639:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.379642:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c83b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.379663:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00800000:00000080:2.0:1767317504.379683:0:81467:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff8c3c49ba6000: cmd=401866d4 len=384 karg=ffff8c3c60d18a00 uarg=0000000000000000 00000002:00000080:2.0:1767317504.379700:0:81467:0:(mdc_request.c:2279:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8c3c49ba6000: cmd=401866d4 len=384 karg=ffff8c3c60d18a00 uarg=0000000000000000 00000020:00100000:2.0:1767317504.379738:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 55, max 7 00000100:00100000:2.0:1767317504.379747:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b100 x1853164291654144/t0(0) o55->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/224 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317504.379773:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654144:192.168.202.133@tcp:55:lfs.0 00000100:00100000:2.0:1767317504.379907:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b300 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.382299:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.382566:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379172992 00000100:00100000:2.0:1767317504.382578:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379172992 00000100:00100000:2.0:1767317504.382648:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9436 00000100:00100000:2.0:1767317504.382660:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379172992:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.382682:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.382773:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.382781:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379172992:12345-192.168.202.133@tcp:104: Request processed in 123us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.382788:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9436 00010000:00010000:1.0:1767317504.382914:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.382923:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.382932:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317504.382937:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.382946:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.382955:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.383029:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.383036:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.383062:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.383068:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442cf51 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71753 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.383083:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.383085:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.383087:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317504.383097:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317504.383112:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291654272:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.387496:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291654272:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317504.387898:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654144:192.168.202.133@tcp:55:lfs.0 00000080:00200008:2.0:1767317504.387931:0:81467:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0](ffff8c3c61726c08) current size 40960, valid attrs 101f0, mode 8c3c, uid 6804, gid 4, new size 4294967296, atime 1767317503.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000, rc 0 00000080:00200008:2.0:1767317504.388032:0:81467:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 40960, valid attrs 101f0, mode 8c3c, uid 6804, gid 4, new size 4294967296, atime 1767317503.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000 00010000:00010000:2.0:1767317504.388072:0:81467:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.388096:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.388155:0:81467:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.388160:0:81467:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317504.388177:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442cf35 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7170d expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767317504.388196:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317504.388592:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b100 x1853164291654528/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317504.388618:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654528:192.168.202.133@tcp:36:lfs.0 00000100:00100000:2.0:1767317504.388713:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b300 going to sleep for 12 seconds 00000100:00100000:2.0:1767317504.391076:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654528:192.168.202.133@tcp:36:lfs.0 00000080:00200000:2.0:1767317504.391149:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 1 restore needed 0 00020000:00200000:2.0:1767317504.391170:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317504.391188:0:81467:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1767317504.391218:0:81467:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767317504.391223:0:81467:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61004ab0, flags 0x0 00010000:00010000:2.0:1767317504.391242:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c5075ac00 type 11 mode 2 res 10737419264/159 (0 18446744073709551615) 00010000:00010000:2.0:1767317504.391297:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.391309:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.391322:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767317504.391340:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654656:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317504.391446:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b300 going to sleep for 11 seconds 00000100:00100000:3.0:1767317504.393853:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.394051:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379173120 00000100:00100000:2.0:1767317504.394061:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379173120 00000100:00100000:2.0:1767317504.394306:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9437 00000100:00100000:2.0:1767317504.394318:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379173120:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.394340:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.394424:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.394432:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379173120:12345-192.168.202.133@tcp:104: Request processed in 116us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.394439:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9437 00010000:00010000:1.0:1767317504.394507:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.394517:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.394526:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317504.394533:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.394558:0:64002:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317504.394575:0:64002:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317504.394623:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.394628:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.394655:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.394660:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cf19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a716c0 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.394674:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.394675:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.394676:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.394716:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.394732:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291654784:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317504.398128:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:1.0:1767317504.398500:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291654656:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.398538:0:81467:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.398577:0:81467:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.398586:0:81467:0:(ldlm_request.c:303:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767317504.398628:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379173248 00000100:00100000:2.0:1767317504.398635:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379173248 00000100:00100000:2.0:1767317504.398713:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9438 00000100:00100000:2.0:1767317504.398722:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379173248:12345-192.168.202.133@tcp:105: 00010000:00010000:2.0:1767317504.398733:0:42090:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398740:0:42090:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398747:0:42090:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398753:0:42090:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398760:0:42090:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398777:0:42090:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.398800:0:42090:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c3c629d1000) 00000100:00100000:2.0:1767317504.398859:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379173248:12345-192.168.202.133@tcp:105: Request processed in 138us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.398865:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9438 00010000:00010000:1.0:1767317504.398988:0:81467:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.398996:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.399011:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.399022:0:81467:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.399032:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.399038:0:81467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317504.399159:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291654912:192.168.202.133@tcp:2:lfs.0 00000100:00100000:0.0:1767317504.402784:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291654784:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.403788:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291654912:192.168.202.133@tcp:2:lfs.0 00000020:00010000:1.0:1767317504.403866:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.404052:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.404060:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317504.404076:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.404093:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317504.404115:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.404119:0:81467:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.404156:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.404182:0:81467:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 40960, valid attrs 101f0, mode 8c3c, uid 6804, gid 4, new size 4294967296, atime 1767317503.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000, rc 0 00000080:00200080:1.0:1767317504.404224:0:81467:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=15c5530 00010000:00010000:1.0:1767317504.404296:0:81467:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.404316:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf4a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71730 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.404345:0:81467:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.404356:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.404360:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291655168/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.404383:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291655168:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.405023:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:2.0:1767317504.407204:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.407309:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379173376 00000100:00100000:3.0:1767317504.407322:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379173376 00000100:00100000:3.0:1767317504.407388:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9439 00000100:00100000:3.0:1767317504.407401:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379173376:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.407423:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.407528:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.407536:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379173376:12345-192.168.202.133@tcp:104: Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.407544:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9439 00010000:00010000:0.0:1767317504.407759:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.407769:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.407779:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cec00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.407785:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.407794:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.407803:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317504.408199:0:42099:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317504.408214:0:42099:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1767317504.408220:0:42099:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291655424/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317504.408248:0:42099:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:42099:1853164291655424:192.168.202.133@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1767317504.408443:0:42099:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1767317504.411179:0:42099:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:42099:1853164291655424:192.168.202.133@tcp:35:ldlm_bl.0 00000002:00100000:0.0:1767317504.411226:0:42099:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9e300 x1853164291649920/t8589937202(8589937202) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317504.411270:0:42099:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.411328:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.411336:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317504.411388:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291655552:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317504.411689:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.411699:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf12 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a716b2 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.411737:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.411740:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.411742:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317504.413577:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.413698:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317504.413717:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379173504 00000100:00100000:1.0:1767317504.413725:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291655552:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317504.413725:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379173504 00000100:00100000:2.0:1767317504.413790:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9440 00000100:00100000:2.0:1767317504.413801:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379173504:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.413819:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.413936:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.413944:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379173504:12345-192.168.202.133@tcp:104: Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.413952:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9440 00010000:00010000:1.0:1767317504.414045:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.414054:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414063:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cea00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317504.414069:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414079:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414088:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.414117:0:42098:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:1.0:1767317504.414164:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414237:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317504.414290:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291655680:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317504.414649:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414656:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf58 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7176f expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.414688:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.414690:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.414691:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.419396:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291655680:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.422394:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291655168:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.422459:0:81467:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0700 x1853164291652096/t8589937207(8589937207) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317504.422526:0:81467:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:1.0:1767317504.422541:0:81467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317504.422609:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.422619:0:81467:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00010000:00010000:1.0:1767317504.422630:0:81467:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81467 initiator: MDT0 00000100:00100000:1.0:1767317504.422657:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291655808:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.422757:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.424789:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291655808:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.424824:0:81467:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.424841:0:81467:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317504.424857:0:81467:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c0a80 x1853164291655808/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.424949:0:81467:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317504.425038:0:81467:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425053:0:81467:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.425059:0:81467:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.425077:0:81467:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf6d 00000080:00010000:1.0:1767317504.425087:0:81467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf6d from it ffffa7f7c1d6fbc8 00010000:00010000:1.0:1767317504.425091:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425102:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425127:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425345:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.425355:0:81467:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425404:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425412:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.425435:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 1 restore needed 0 00020000:00200000:1.0:1767317504.425450:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.425492:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317504.425505:0:81467:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425513:0:81467:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.425521:0:81467:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.425536:0:81467:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.425540:0:81467:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.425547:0:81467:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1767317504.425561:0:81467:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 40960 blocks 88 [cma]time: 1767317504 1767317504 0 by oinfo size 40960 blocks 88 [cma]time 1767317504 1767317504 1767317503 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.425638:0:81467:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 1 00010000:00010000:1.0:1767317504.425643:0:81467:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.425651:0:81467:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317504.425689:0:81467:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 1154002 00000002:00100000:1.0:1767317504.425734:0:81467:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.425751:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.425756:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291656064/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.425778:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291656064:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.425967:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.429562:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291656064:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.429612:0:81467:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9d500 x1853164291650304/t8589937203(8589937203) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317504.429707:0:81467:0:(file.c:424:ll_file_release()) START file . :VOLATILE:0000:3420F956:fd=03:[0x200000405:0x8b:0x0](ffff8c3c61726c08), flags 554001 00000002:00100000:1.0:1767317504.429776:0:81467:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.429789:0:81467:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.429795:0:81467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291656320/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.429821:0:81467:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291656320:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.430392:0:81467:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.434382:0:81467:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81467:1853164291656320:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.434423:0:81467:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291650688/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317504.443430:0:81468:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317504.443482:0:81468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317504.443571:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81468 initiator: MDT0 00010000:00010000:2.0:1767317504.443583:0:81468:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00010000:00010000:2.0:1767317504.443603:0:81468:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000100:00100000:2.0:1767317504.443639:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656448:192.168.202.133@tcp:101:dd.0 00000100:00100000:2.0:1767317504.443820:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474b300 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.447649:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656448:192.168.202.133@tcp:101:dd.0 00010000:00010000:0.0:1767317504.447683:0:81468:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447696:0:81468:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447709:0:81468:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447721:0:81468:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447734:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447742:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447749:0:81468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.447761:0:81468:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38700 x1853164291656448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.447776:0:81468:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.447815:0:81468:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317504.447823:0:81468:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.447858:0:81468:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317504.447865:0:81468:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf74 00000080:00010000:0.0:1767317504.447994:0:81468:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.447998:0:81468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf74 from it ffffa7f7c1dafbf8 00010000:00010000:0.0:1767317504.448001:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448011:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.448043:0:81468:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.448070:0:81468:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317504.448089:0:81468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.448097:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448107:0:81468:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.448113:0:81468:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.448117:0:81468:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.448120:0:81468:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf74 00000080:00010000:0.0:1767317504.448123:0:81468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf74 from it ffffa7f7c1dafb38 00010000:00010000:0.0:1767317504.448126:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448143:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.448151:0:81468:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317504.448157:0:81468:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c629c0000, open_flags c241, mode 81b6 opened 0 00000080:00200000:0.0:1767317504.448167:0:81468:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:0.0:1767317504.448326:0:81468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x200000405:0x8c:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0141102 00010000:00010000:0.0:1767317504.448340:0:81468:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448397:0:81468:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448405:0:81468:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.448408:0:81468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442cf74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a717b5 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.448545:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81468 initiator: MDT0 00010000:00010000:0.0:1767317504.448553:0:81468:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000020:00100000:0.0:1767317504.448566:0:81468:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317504.448575:0:81468:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291656704/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317504.448584:0:81468:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000100:00100000:0.0:1767317504.448619:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656704:192.168.202.133@tcp:101:dd.0 00000100:00100000:0.0:1767317504.448814:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.453318:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656704:192.168.202.133@tcp:101:dd.0 00010000:00010000:0.0:1767317504.453355:0:81468:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453385:0:81468:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453394:0:81468:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453407:0:81468:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453427:0:81468:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453441:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453449:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.453457:0:81468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.453481:0:81468:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317504.453517:0:81468:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.453533:0:81468:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317504.453549:0:81468:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.453563:0:81468:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.453571:0:81468:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317504.453630:0:81468:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 40960 00000080:00200000:0.0:1767317504.453635:0:81468:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff8c3c597df448): rc = 0 00000080:00200000:0.0:1767317504.453651:0:81468:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 1 -> 1 00000080:00010000:0.0:1767317504.453658:0:81468:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf7b 00000080:00010000:0.0:1767317504.453671:0:81468:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00200008:0.0:1767317504.453691:0:81468:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 141101 00000002:00100000:0.0:1767317504.453718:0:81468:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317504.453756:0:81468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf7b from it ffff8c3c62906c60 00010000:00010000:0.0:1767317504.453760:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.453770:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.453796:0:81468:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 42 00000002:00010000:0.0:1767317504.453827:0:81468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8a:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1767317504.454499:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81468 initiator: MDT0 00010000:00010000:0.0:1767317504.454512:0:81468:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00010000:00010000:0.0:1767317504.454523:0:81468:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000100:00100000:0.0:1767317504.454550:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656832:192.168.202.133@tcp:101:dd.0 00000100:00100000:0.0:1767317504.454669:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.458127:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291656832:192.168.202.133@tcp:101:dd.0 00010000:00010000:0.0:1767317504.458164:0:81468:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.458199:0:81468:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.458213:0:81468:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.458228:0:81468:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff8c3c50e9d500 x1853164291656832/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 568/1336 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.458240:0:81468:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.458257:0:81468:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.458265:0:81468:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8a:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1767317504.458306:0:81468:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf82 00000080:00010000:0.0:1767317504.458316:0:81468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf82 from it ffffa7f7c1dafa48 00010000:00010000:0.0:1767317504.458337:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.458347:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317504.458392:0:81468:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 40960, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000 00010000:00010000:0.0:1767317504.458439:0:81468:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.458463:0:81468:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.458516:0:81468:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.458524:0:81468:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.458527:0:81468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf7b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717d1 expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317504.458552:0:81468:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317504.458559:0:81468:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d500 x1853164291657088/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317504.458586:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657088:192.168.202.133@tcp:36:dd.0 00000100:00100000:0.0:1767317504.458686:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1cad80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.466694:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657088:192.168.202.133@tcp:36:dd.0 00000080:00200000:0.0:1767317504.466755:0:81468:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1767317504.466780:0:81468:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.466794:0:81468:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x8a:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1767317504.466801:0:81468:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 1 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.466805:0:81468:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x8a:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1767317504.466816:0:81468:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:0.0:1767317504.466832:0:81468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 02 00010000:00010000:0.0:1767317504.466860:0:81468:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.467006:0:81468:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.467056:0:81468:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.467064:0:81468:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.467068:0:81468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cf6d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717a0 expref: -99 pid: 81467 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.467099:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81468 initiator: MDT0 00010000:00010000:0.0:1767317504.467106:0:81468:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000020:00100000:0.0:1767317504.467117:0:81468:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317504.467126:0:81468:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291657344/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317504.467382:0:81468:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81468 initiator: MDT0 00000100:00100000:1.0:1767317504.467722:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657344:192.168.202.133@tcp:101:dd.0 00000100:00100000:1.0:1767317504.467900:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.475603:0:81468:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937219 gen 1 00000100:00100000:1.0:1767317504.475655:0:81468:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317504.475674:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657344:192.168.202.133@tcp:101:dd.0 00010000:00010000:1.0:1767317504.475699:0:81468:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475713:0:81468:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475727:0:81468:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475740:0:81468:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475826:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475837:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475845:0:81468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317504.475856:0:81468:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9c380 x1853164291657344/t8589937219(8589937219) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.475923:0:81468:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317504.475955:0:81468:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.475971:0:81468:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.475979:0:81468:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.475992:0:81468:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf89 00000080:00010000:1.0:1767317504.476002:0:81468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf89 from it ffffa7f7c1daf930 00010000:00010000:1.0:1767317504.476006:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476015:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.476035:0:81468:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767317504.476043:0:81468:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 1 restore needed 0 00010000:00010000:1.0:1767317504.476058:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476070:0:81468:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.476079:0:81468:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476125:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476132:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.476151:0:81468:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.476164:0:81468:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.476167:0:81468:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.476174:0:81468:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.476207:0:81468:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317504.476218:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476226:0:81468:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.476233:0:81468:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.476247:0:81468:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.476251:0:81468:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.476253:0:81468:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.476255:0:81468:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.476261:0:81468:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.476327:0:81468:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 2 00010000:00010000:1.0:1767317504.476332:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.476339:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00020000:00200000:1.0:1767317504.476350:0:81468:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8a:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1767317504.476360:0:81468:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.476362:0:81468:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.476366:0:81468:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.476375:0:81468:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317504.476387:0:81468:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1767317504.476391:0:81468:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x80000000 00010000:00010000:1.0:1767317504.476406:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.476416:0:81468:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.476428:0:81468:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.476440:0:81468:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.476451:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.476458:0:81468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317504.477220:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291657472:192.168.202.133@tcp:10:dd.0 00000100:00100000:0.0:1767317504.485353:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291657472:192.168.202.133@tcp:10:dd.0 00000080:00200000:1.0:1767317504.485479:0:81468:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767317504.485489:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.485493:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.485498:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317504.485529:0:81468:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.485544:0:81468:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317504.485562:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.485565:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.485584:0:81468:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.485599:0:81468:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000, rc 0 00000080:00200008:1.0:1767317504.485730:0:81468:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767317504.485740:0:81468:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767317504.485752:0:81468:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767317504.485761:0:81468:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767317504.485763:0:81468:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:1.0:1767317504.485768:0:81468:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.485783:0:81468:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8a:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:1.0:1767317504.485787:0:81468:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.485791:0:81468:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317504.485796:0:81468:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317504.485805:0:81468:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767317504.485809:0:81468:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.485825:0:81468:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767317504.485839:0:81468:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:1.0:1767317504.485843:0:81468:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x0 00000080:00200000:1.0:1767317504.485853:0:81468:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767317504.485867:0:81468:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767317504.486238:0:81468:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317504.486249:0:81468:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:1.0:1767317504.486256:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.486259:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.486262:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.486265:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.486268:0:81468:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.486273:0:81468:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767317504.486277:0:81468:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317504.486301:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319a80 00000008:00100000:1.0:1767317504.486478:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c1c00 - object 0x280000400:159 offset 0<>4096 00000100:00100000:0.0:1767317504.486544:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291657600:192.168.202.133@tcp:4:dd.0 00000100:00100000:2.0:1767317504.489394:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.489966:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379174400 00000100:00100000:3.0:1767317504.489981:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379174400 00000100:00100000:3.0:1767317504.490128:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9441 00000100:00100000:3.0:1767317504.490150:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379174400:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.490174:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.490291:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.490299:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379174400:12345-192.168.202.133@tcp:104: Request processed in 153us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.490307:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9441 00010000:00010000:0.0:1767317504.490371:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.490381:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.490390:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317504.490397:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400020000 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317504.490435:0:50308:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317504.490454:0:50308:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767317504.490517:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.490525:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.490570:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.490579:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442cf66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a7178b expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.490608:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.490611:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.490612:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.490629:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.490653:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291657728:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.494032:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291657728:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.496031:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875993 gen 2 00000008:00010000:0.0:1767317504.496093:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319a80 00000020:00200000:0.0:1767317504.496101:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317504.496112:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317504.496185:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319a80 00000100:00100000:0.0:1767317504.496215:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291657600:192.168.202.133@tcp:4:dd.0 00000080:00200000:1.0:1767317504.499386:0:81468:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317504.499497:0:81468:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.499506:0:81468:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767317504.499527:0:81468:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:1.0:1767317504.499533:0:81468:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.499550:0:81468:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:1.0:1767317504.499606:0:81468:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 140001 00000002:00100000:1.0:1767317504.499713:0:81468:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.499729:0:81468:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.499735:0:81468:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291657984/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.499768:0:81468:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657984:192.168.202.133@tcp:35:dd.0 00000100:00100000:1.0:1767317504.500715:0:81468:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.516169:0:81468:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job dd:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81468:1853164291657984:192.168.202.133@tcp:35:dd.0 00000002:00100000:1.0:1767317504.516223:0:81468:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9e300 x1853164291656704/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317504.547036:0:81469:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317504.547079:0:81469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.547189:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81469 initiator: MDT0 00010000:00010000:0.0:1767317504.547202:0:81469:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81469 initiator: MDT0 00010000:00010000:0.0:1767317504.547214:0:81469:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81469 initiator: MDT0 00000100:00100000:0.0:1767317504.547246:0:81469:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81469:1853164291658112:192.168.202.133@tcp:101:ls.0 00000100:00100000:0.0:1767317504.547393:0:81469:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.550219:0:81469:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81469:1853164291658112:192.168.202.133@tcp:101:ls.0 00010000:00010000:0.0:1767317504.550253:0:81469:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550268:0:81469:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550305:0:81469:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550318:0:81469:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550333:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550342:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550350:0:81469:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.550364:0:81469:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d880 x1853164291658112/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.550379:0:81469:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550395:0:81469:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317504.550402:0:81469:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.550538:0:81469:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317504.550547:0:81469:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:0.0:1767317504.550554:0:81469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.550558:0:81469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c147bb58 00010000:00010000:0.0:1767317504.550561:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.550577:0:81469:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.550611:0:81469:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.550638:0:81469:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317504.550644:0:81469:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317504.550676:0:81469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.550731:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81469 initiator: MDT0 00010000:00010000:0.0:1767317504.550740:0:81469:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81469 initiator: MDT0 00010000:00010000:0.0:1767317504.550750:0:81469:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81469 initiator: MDT0 00000100:00100000:0.0:1767317504.550775:0:81469:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81469:1853164291658240:192.168.202.133@tcp:101:ls.0 00000100:00100000:0.0:1767317504.550972:0:81469:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.561420:0:81469:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81469:1853164291658240:192.168.202.133@tcp:101:ls.0 00010000:00010000:0.0:1767317504.561463:0:81469:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561496:0:81469:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561505:0:81469:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561549:0:81469:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561563:0:81469:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561578:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561587:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.561595:0:81469:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.561608:0:81469:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d880 x1853164291658240/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.561621:0:81469:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317504.561639:0:81469:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.561651:0:81469:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.561659:0:81469:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317504.561722:0:81469:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff8c3c597df448): rc = 0 00000080:00200000:0.0:1767317504.561739:0:81469:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:0.0:1767317504.561745:0:81469:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf97 00000080:00010000:0.0:1767317504.561766:0:81469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.561770:0:81469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf97 from it ffffa7f7c147bb20 00010000:00010000:0.0:1767317504.561774:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.561782:0:81469:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317504.561843:0:81469:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 606, flags 0, foreign 0 00000080:00200000:0.0:1767317504.561852:0:81469:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.562321:0:81469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.562335:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.562349:0:81469:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.562356:0:81469:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.562533:0:81469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.562538:0:81469:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf97 00000080:00010000:0.0:1767317504.562544:0:81469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf97 from it ffffa7f7c147bcb8 00010000:00010000:0.0:1767317504.562548:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.562557:0:81469:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.562582:0:81469:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.562597:0:81469:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.562610:0:81469:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.562615:0:81469:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.562641:0:81469:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.562646:0:81469:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d2879b0, osc lock ffff8c3c50c8f1d0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.562713:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.562723:0:81469:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.562738:0:81469:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9d880 x1853164291658368/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.562842:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291658368:192.168.202.133@tcp:101:ls.0 00000020:00200000:0.0:1767317504.563311:0:81469:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.566289:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.566323:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.566341:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.566356:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.566390:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.566406:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317504.566431:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317504.566646:0:81469:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.566653:0:81469:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.566657:0:81469:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.566664:0:81469:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d2879b0 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.566669:0:81469:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.566673:0:81469:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d2879b0 (ffff8c3c547fdd88/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.566692:0:81469:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.566792:0:81469:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317504.566823:0:81469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.566841:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.566856:0:81469:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.566866:0:81469:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.566942:0:81469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.566947:0:81469:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:0.0:1767317504.566955:0:81469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c147bbf8 00010000:00010000:0.0:1767317504.566959:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.566968:0:81469:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.566986:0:81469:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.566994:0:81469:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200000:0.0:1767317504.567027:0:81469:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317504.567034:0:81469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.567041:0:81469:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.567049:0:81469:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.567055:0:81469:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.567058:0:81469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317504.567061:0:81469:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:0.0:1767317504.567064:0:81469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c147bbf8 00010000:00010000:0.0:1767317504.567067:0:81469:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.567074:0:81469:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.567082:0:81469:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317504.567093:0:81469:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00010000:00010000:1.0:1767317504.569430:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.569447:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.569484:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.569515:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291658368:192.168.202.133@tcp:101:ls.0 00000080:00200000:1.0:1767317504.592252:0:81470:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.592295:0:81470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.592317:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.592337:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.592347:0:81470:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.592357:0:81470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.592561:0:81470:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.592574:0:81470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c1483bf8 00010000:00010000:1.0:1767317504.592579:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.592591:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.592611:0:81470:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.592624:0:81470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767317504.592631:0:81470:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 44 00000080:00200008:1.0:1767317504.592638:0:81470:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 100000 00000002:00010000:1.0:1767317504.592668:0:81470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100001 00010000:00010000:1.0:1767317504.592737:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81470 initiator: MDT0 00010000:00010000:1.0:1767317504.592745:0:81470:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81470 initiator: MDT0 00000020:00100000:1.0:1767317504.592759:0:81470:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.592774:0:81470:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291658624/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.592785:0:81470:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81470 initiator: MDT0 00000100:00100000:1.0:1767317504.592814:0:81470:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job md5sum:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81470:1853164291658624:192.168.202.133@tcp:101:md5sum.0 00000100:00100000:1.0:1767317504.593116:0:81470:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.600316:0:81470:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job md5sum:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81470:1853164291658624:192.168.202.133@tcp:101:md5sum.0 00010000:00010000:1.0:1767317504.600359:0:81470:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.600372:0:81470:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.600385:0:81470:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.600397:0:81470:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.600428:0:81470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c0700 x1853164291658624/t8589937221(8589937221) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.600464:0:81470:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291658624/t8589937221(8589937221) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.600488:0:81470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317504.600504:0:81470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.600516:0:81470:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.600525:0:81470:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317504.600597:0:81470:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:1.0:1767317504.600604:0:81470:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfa5 00000080:00010000:1.0:1767317504.600614:0:81470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfa5 from it ffffa7f7c1483bf0 00010000:00010000:1.0:1767317504.600619:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.600630:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317504.600666:0:81470:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291658624/t8589937221(8589937221) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317504.600836:0:81470:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.600845:0:81470:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.600926:0:81470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.600939:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.600963:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.600982:0:81470:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.600989:0:81470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317504.600993:0:81470:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf97 00000080:00010000:1.0:1767317504.600997:0:81470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf97 from it ffffa7f7c1483cd8 00010000:00010000:1.0:1767317504.601000:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.601007:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.601027:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.601042:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.601045:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.601049:0:81470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.601072:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.601076:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.601095:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.601104:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.601118:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.601122:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.601502:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.601516:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.601530:0:81470:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.601535:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.601538:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.601541:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.601545:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.601549:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.601561:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.601607:0:81470:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 32768 00000080:00200000:1.0:1767317504.601614:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.601620:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.601623:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317504.601628:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.601633:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.601637:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.601640:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.601642:0:81470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.601652:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.601655:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.601666:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.601676:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.601692:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.601695:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.601703:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.601712:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.601717:0:81470:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.601720:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.601723:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.601726:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.601729:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.601731:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.601737:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.601742:0:81470:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 32768] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767317504.601772:0:81470:0:(rw.c:2016:ll_readpage()) fast read pgno: 0 00000080:00200000:1.0:1767317504.601785:0:81470:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:1.0:1767317504.601790:0:81470:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767317504.601798:0:81470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 1, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767317504.601801:0:81470:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 0 0 00000080:00200000:1.0:1767317504.601804:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.601813:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.601815:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00020000:00200000:1.0:1767317504.601823:0:81470:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767317504.601827:0:81470:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.601841:0:81470:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767317504.601855:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317504.601858:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000000000000 00010000:00010000:1.0:1767317504.601865:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.602099:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.602109:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.602118:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.602125:0:81470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.602215:0:81470:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:1.0:1767317504.602229:0:81470:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000008:00010000:1.0:1767317504.602284:0:81470:0:(osc_cache.c:2941:osc_queue_sync_pages()) ### no dlm lock: extent: ffff8c3c5a319840 00000008:00010000:1.0:1767317504.602334:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319840 00010000:00010000:1.0:1767317504.602360:0:77461:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000008:00100000:1.0:1767317504.602405:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c0e00 - object 0x280000400:159 offset 0<>4096 00000100:00100000:0.0:1767317504.602746:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291658752:192.168.202.133@tcp:3:md5sum.0 00000008:00010000:0.0:1767317504.608940:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319840 00000020:00200000:0.0:1767317504.608974:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317504.608988:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319840 00000100:00100000:0.0:1767317504.609022:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291658752:192.168.202.133@tcp:3:md5sum.0 00000020:00010000:1.0:1767317504.609369:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.609374:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.609379:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317504.609392:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609424:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317504.609444:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.609448:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.609459:0:81470:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000080:00200000:1.0:1767317504.609480:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.609486:0:81470:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767317504.609492:0:81470:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200008:1.0:1767317504.609517:0:81470:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 24576 00000080:00200000:1.0:1767317504.609525:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.609538:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.609541:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317504.609555:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.609561:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.609565:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.609567:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.609570:0:81470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.609587:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.609592:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.609617:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609632:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.609656:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.609659:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609667:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.609677:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.609685:0:81470:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.609689:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.609692:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.609695:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.609698:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.609700:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.609706:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.609711:0:81470:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [4096, 28672] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767317504.609744:0:81470:0:(rw.c:2016:ll_readpage()) fast read pgno: 1 00000080:00200000:1.0:1767317504.609752:0:81470:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 4096, bytes: 24576 00000080:00200000:1.0:1767317504.609757:0:81470:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767317504.609765:0:81470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767317504.609768:0:81470:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [4096, 28672) 0 0 00000080:00200000:1.0:1767317504.609771:0:81470:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.609779:0:81470:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.609782:0:81470:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00020000:00200000:1.0:1767317504.609788:0:81470:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 28672) 28672, 24576 00020000:00200000:1.0:1767317504.609792:0:81470:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.609806:0:81470:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 6] 00000008:00010000:1.0:1767317504.609820:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317504.609823:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000000000000 00010000:00010000:1.0:1767317504.609832:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609840:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 28671) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609849:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609857:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609865:0:81470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.609919:0:81470:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [4096, 28672) 00000001:00010000:1.0:1767317504.609929:0:81470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.609934:0:81470:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.609936:0:81470:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c87b0, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317504.609943:0:81470:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609951:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.609968:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.609971:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 7/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.609984:0:81470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 6/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.609991:0:81470:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.609996:0:81470:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.609999:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.610001:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.610004:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c87b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.610006:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.610009:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c87b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.610015:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.610017:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.610019:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317504.610023:0:81470:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.610030:0:81470:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317504.610037:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.610039:0:81470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.610043:0:81470:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000080:00200000:1.0:1767317504.610047:0:81470:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.610051:0:81470:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000080:00200000:1.0:1767317504.610053:0:81470:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200008:1.0:1767317504.610098:0:81470:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR 00000080:00200008:1.0:1767317504.610110:0:81470:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR, rc = 4096 00000080:00200008:1.0:1767317504.610294:0:81470:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 100000 00010000:00010000:1.0:1767317504.610326:0:81470:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.633315:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.633358:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.633380:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.633400:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.633499:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.633511:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.633516:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.633526:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bbf8 00010000:00010000:1.0:1767317504.633531:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.633542:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.633563:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.633574:0:81471:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767317504.633581:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 44 00000080:00200008:1.0:1767317504.633590:0:81471:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154400 00000080:00200000:1.0:1767317504.633681:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317504.633690:0:81471:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), xattr lov 00000080:00200008:1.0:1767317504.633740:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.633747:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.633763:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.633774:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.633784:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.633791:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.633796:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317504.633798:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf97 00000080:00010000:1.0:1767317504.633802:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf97 from it ffffa7f7c146bcd8 00010000:00010000:1.0:1767317504.633806:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.633813:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.633834:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.633847:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.633851:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.633856:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.633929:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.633933:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.633954:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.633965:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.633986:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.633990:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.633998:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.634010:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.634025:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.634030:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.634033:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.634037:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.634042:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.634045:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.634057:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.634095:0:81471:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154000 00010000:00010000:1.0:1767317504.634111:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.635358:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.635388:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.635402:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.635498:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.635520:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.635529:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.635533:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.635540:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bb58 00010000:00010000:1.0:1767317504.635545:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.635554:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.635571:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.635581:0:81471:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00000080:00200008:1.0:1767317504.635592:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.635598:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.635611:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.635619:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.635628:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.635635:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.635639:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317504.635641:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cf97 00000080:00010000:1.0:1767317504.635645:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf97 from it ffffa7f7c146bcb8 00010000:00010000:1.0:1767317504.635648:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.635666:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.635688:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.635699:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.635703:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.635706:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.635726:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.635730:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.635746:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.635755:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.635767:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.635770:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.635778:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.635787:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.635798:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.635801:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.635804:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.635808:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.635819:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.635822:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.635835:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317504.638589:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.638638:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.638660:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.638677:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.638686:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.638699:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.638703:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.638711:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bbf8 00010000:00010000:1.0:1767317504.638715:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.638725:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.638743:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.638755:0:81471:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767317504.638763:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 46 00000080:00200008:1.0:1767317504.638774:0:81471:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154402 00000002:00010000:1.0:1767317504.638792:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1767317504.638861:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.638923:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317504.638940:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.638955:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2d80 x1853164291659008/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.639316:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.639347:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659008:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.639701:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.647204:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.647256:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379174528 00000100:00100000:3.0:1767317504.647267:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379174528 00000100:00100000:3.0:1767317504.647331:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9442 00000100:00100000:3.0:1767317504.647341:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379174528:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.647363:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.647459:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.647466:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379174528:12345-192.168.202.133@tcp:104: Request processed in 126us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.647482:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9442 00010000:00010000:0.0:1767317504.647712:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.647723:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647732:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cf000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.647739:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647748:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647756:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647791:0:63742:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647802:0:63742:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647853:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647923:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.647952:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647960:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cf97 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a7182c expref: -99 pid: 81469 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.647979:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.647981:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.647984:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.647994:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317504.648014:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291659136:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.657743:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291659136:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.657862:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659008:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.657939:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.657960:0:81471:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.657969:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.657984:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.657997:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.658011:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.658040:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.658049:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.658062:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.658077:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.658094:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.658106:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.658114:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.658173:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfac 00000080:00010000:1.0:1767317504.658182:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfac from it ffffa7f7c146bbf0 00010000:00010000:1.0:1767317504.658185:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.658194:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.658225:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317504.661216:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317504.661263:0:81471:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), xattr lov 00000080:00200008:1.0:1767317504.661314:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.661325:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.661353:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.661371:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:1.0:1767317504.661444:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.661454:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.661465:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.661510:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659264:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.661644:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:3.0:1767317504.666314:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.666962:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379174656 00000100:00100000:2.0:1767317504.666977:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379174656 00000100:00100000:2.0:1767317504.667045:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9443 00000100:00100000:2.0:1767317504.667057:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379174656:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.667078:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317504.667233:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.667240:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379174656:12345-192.168.202.133@tcp:104: Request processed in 185us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.667249:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9443 00010000:00010000:0.0:1767317504.668124:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.668136:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668154:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.668161:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668172:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668182:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668263:0:63276:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.668314:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668321:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.668365:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668373:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442cfac lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71856 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.668390:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.668392:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.668394:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.668416:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.668439:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291659392:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.671348:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291659392:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.673168:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659264:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.673201:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673216:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673230:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673243:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673258:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673286:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.673294:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.673307:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291659264/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/824 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.673321:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317504.673416:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.673435:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.673534:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.673608:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:0.0:1767317504.673614:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfb3 00000080:00010000:0.0:1767317504.673620:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.673631:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfb3 from it ffffa7f7c146bcd8 00010000:00010000:0.0:1767317504.673634:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.673644:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.673686:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:0.0:1767317504.673699:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.673703:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.673706:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.673728:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.673731:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287cb0, osc lock ffff8c3c50c8f1d0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.673750:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.673763:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.673776:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.673781:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.673790:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.673802:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.673815:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.673819:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.673829:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.673833:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287cb0 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.673838:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.673842:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287cb0 (ffff8c3c547fdd88/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.673855:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1767317504.674009:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=21e22e0 00000002:00010000:0.0:1767317504.674043:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 05004040000002 00010000:00010000:0.0:1767317504.674145:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.674167:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317504.674424:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0700 x1853164291658624/t8589937221(8589937221) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317504.674437:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317504.674455:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c700 x1853164291659648/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317504.674491:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659648:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317504.674617:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1767317504.679641:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659648:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317504.679688:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0700 x1853164291658624/t8589937221(8589937221) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317504.679744:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.679834:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.679842:0:81471:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.679846:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442cfa5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71841 expref: -99 pid: 81470 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.679930:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:0.0:1767317504.679938:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:0.0:1767317504.679950:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317504.679969:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c700 x1853164291659904/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317504.679981:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 81471 initiator: MDT0 00000100:00100000:0.0:1767317504.680006:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659904:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.680251:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.689479:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291659904:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.689515:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689530:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689572:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689586:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689602:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689611:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689620:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.689631:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317504.689645:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.689663:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689679:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.689688:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317504.689715:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317504.689737:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfba 00000080:00010000:0.0:1767317504.689746:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfba from it ffffa7f7c146bcc0 00010000:00010000:0.0:1767317504.689750:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.689758:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317504.689836:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:0.0:1767317504.689853:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.689857:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317504.689865:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767317504.690158:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660032:192.168.202.133@tcp:1:lfs.0 00000100:00100000:3.0:1767317504.693482:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.693579:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379174784 00000100:00100000:2.0:1767317504.693593:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379174784 00000100:00100000:2.0:1767317504.693664:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9444 00000100:00100000:2.0:1767317504.693676:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19256:x1853164379174784:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.693696:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.693800:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.693808:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19256:x1853164379174784:12345-192.168.202.133@tcp:104: Request processed in 134us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.693836:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9444 00010000:00010000:1.0:1767317504.694074:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.694083:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.694093:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cea00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317504.694100:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.694124:0:63490:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00000080:00200000:1.0:1767317504.694214:0:63490:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317504.694272:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.694291:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.694321:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.694330:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442cf9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71833 expref: -99 pid: 81469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.694359:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.694361:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.694363:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317504.694380:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317504.694398:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.697262:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.698481:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660032:192.168.202.133@tcp:1:lfs.0 00010000:00010000:0.0:1767317504.698642:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.698673:0:81471:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.698695:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.698705:0:81471:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767317504.698754:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.698762:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.698768:0:81471:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317504.698772:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cf89 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a717fb expref: -99 pid: 81468 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.698813:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442cfb3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7186b expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317504.698833:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317504.698843:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9fb80 x1853164291660416/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317504.698903:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660416:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317504.698997:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.708977:0:81471:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937225 gen 1 00000100:00100000:0.0:1767317504.709007:0:81471:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317504.709020:0:81471:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317504.709031:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660416:192.168.202.133@tcp:36:lfs.0 00010000:00010000:0.0:1767317504.709385:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/138 (0 0) 00000080:00010000:0.0:1767317504.709401:0:81471:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:0.0:1767317504.709416:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317504.709573:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:0.0:1767317504.709584:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:0.0:1767317504.709595:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:0.0:1767317504.709647:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660544:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.709763:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.713791:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660544:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.713832:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.713849:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317504.713865:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9fb80 x1853164291660544/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.713927:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317504.713942:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.713959:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.713966:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317504.713995:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc1 00000080:00010000:0.0:1767317504.714006:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc1 from it ffffa7f7c146bc70 00010000:00010000:0.0:1767317504.714011:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714022:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714086:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714099:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317504.714107:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714167:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714185:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.714203:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.714218:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.714221:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317504.714229:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.714298:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317504.714365:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.714374:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317504.714381:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.714410:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.714414:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.714417:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317504.714420:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.715246:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.715344:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1767317504.715353:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.715365:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317504.715396:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=66f4 arg=21e22e0 00000080:00200008:0.0:1767317504.715412:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.715422:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.715728:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.715740:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:0.0:1767317504.715795:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:0.0:1767317504.715804:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:0.0:1767317504.715816:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:0.0:1767317504.715847:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660672:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.716396:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.720061:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291660672:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.720092:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720104:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720116:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720125:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720143:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720149:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.720155:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.720162:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9fb80 x1853164291660672/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/824 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.720281:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317504.720294:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.720326:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.720333:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317504.720400:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1767317504.720406:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:0.0:1767317504.720412:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.720416:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:0.0:1767317504.720419:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.720428:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.720555:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:0.0:1767317504.720570:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.720573:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.720577:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.720596:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.720599:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287cb0, osc lock ffff8c3c50c8f1d0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.720650:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.720656:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.720663:0:81471:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9fb80 x1853164291660800/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.720737:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660800:192.168.202.133@tcp:101:lfs.0 00000020:00200000:0.0:1767317504.721423:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.723406:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.723435:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.727575:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.727837:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.727858:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.727936:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317504.728099:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.728110:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.728118:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.728140:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.728167:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291660800:192.168.202.133@tcp:101:lfs.0 00000080:00200000:0.0:1767317504.728578:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.728802:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.728809:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.728816:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287cb0 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.728821:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.728823:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287cb0 (ffff8c3c547fdd88/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.728841:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1767317504.806001:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317504.806024:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317504.806034:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:2.0:1767317504.806062:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317504.806082:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.806099:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.806107:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317504.806116:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:2.0:1767317504.806120:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:2.0:1767317504.806127:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:2.0:1767317504.806131:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.806139:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.806167:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1767317504.806181:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317504.806185:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317504.806189:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767317504.806212:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317504.806216:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179db0, osc lock ffff8c3c61004000, flags 0x400000400001002 00010000:00010000:2.0:1767317504.806235:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806256:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.806269:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317504.806273:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806282:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.806480:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.806492:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767317504.806496:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.806500:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.806503:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.806507:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.806509:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.806521:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317504.806537:0:81471:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1767317504.806544:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767317504.806548:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317504.806727:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317504.806733:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317504.806752:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:2.0:1767317504.806761:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317504.806766:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1767317504.806775:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317504.806781:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317504.806786:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1767317504.806793:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1767317504.806795:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179db0, osc lock ffff8c3c61004000, flags 0x0 00010000:00010000:2.0:1767317504.806806:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806817:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806826:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806834:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.806841:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317504.806851:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000100:00100000:3.0:1767317504.807117:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291660928:192.168.202.133@tcp:23:lfs.0 00000100:00100000:2.0:1767317504.812850:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291660928:192.168.202.133@tcp:23:lfs.0 00000020:00010000:0.0:1767317504.815830:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.815845:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.815853:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767317504.815867:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.815905:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767317504.816478:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.816487:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.816525:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.816541:0:81471:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1767317504.816560:0:81471:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1767317504.816572:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767317504.816584:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.816598:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317504.816604:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.816637:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:0.0:1767317504.816644:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.816677:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1767317504.816680:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.816687:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.816702:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1767317504.816720:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1767317504.816723:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287cb0, osc lock ffff8c3c50c8f1d0, flags 0x0 00010000:00010000:0.0:1767317504.816749:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.816766:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.816780:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.816789:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.816797:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317504.816810:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000100:00100000:1.0:1767317504.817814:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291661056:192.168.202.133@tcp:23:lfs.0 00000100:00100000:1.0:1767317504.822909:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291661056:192.168.202.133@tcp:23:lfs.0 00000020:00010000:2.0:1767317504.823490:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.823497:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.823504:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287cb0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317504.823528:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.823570:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317504.823600:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.823603:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287cb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.823624:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317504.823639:0:81471:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE, rc = 4096 00000080:00200080:2.0:1767317504.823661:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317504.823674:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317504.823683:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317504.823703:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:2.0:1767317504.823732:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317504.823753:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.823768:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.823777:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317504.823786:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:2.0:1767317504.823790:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:2.0:1767317504.823797:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:2.0:1767317504.823801:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.823823:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317504.823854:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1767317504.823866:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317504.823909:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317504.823914:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767317504.823935:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317504.823940:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511791b0, osc lock ffff8c3c61005b50, flags 0x400000400001002 00010000:00010000:2.0:1767317504.823967:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.823978:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.823992:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317504.823995:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317504.824003:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317504.824013:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317504.824026:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767317504.824030:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.824032:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.824035:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511791b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.824038:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.824041:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511791b0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.824048:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317504.824084:0:81471:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1767317504.824090:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767317504.824095:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317504.824097:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317504.824102:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317504.824112:0:81471:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1767317504.824123:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767317504.824140:0:81471:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767317504.824143:0:81471:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1767317504.824146:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000080:00200000:2.0:1767317504.824155:0:81471:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317504.824164:0:81471:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1767317504.824169:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317504.824183:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317504.824193:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317504.824196:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511791b0, osc lock ffff8c3c61005b50, flags 0x40000 00000080:00200000:2.0:1767317504.824202:0:81471:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:2.0:1767317504.824214:0:81471:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1767317504.824222:0:81471:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317504.824285:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317504.824289:0:81471:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:2.0:1767317504.824295:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317504.824298:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.824301:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511791b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317504.824304:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317504.824306:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511791b0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317504.824312:0:81471:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317504.824316:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317504.824343:0:11272:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f9c0 00000008:00100000:2.0:1767317504.824402:0:11272:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a39500 - object 0x280000400:159 offset 0<>4096 00000100:00100000:2.0:1767317504.824454:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317504.824487:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291661184:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317504.830348:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f9c0 00000020:00200000:3.0:1767317504.830363:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317504.830374:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317504.830496:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f9c0 00000100:00100000:3.0:1767317504.830538:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291661184:192.168.202.133@tcp:3:lfs.0 00000080:00200000:0.0:1767317504.831099:0:81471:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317504.831115:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.831120:0:81471:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000020:00200000:0.0:1767317504.831123:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.831233:0:81471:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200080:0.0:1767317504.831256:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317504.831268:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=2 00000080:00200008:0.0:1767317504.831295:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.831302:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.831326:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.831346:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.831360:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.831369:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.831379:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.831385:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:0.0:1767317504.831394:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:0.0:1767317504.831398:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.831408:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.831512:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767317504.831632:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.831635:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.831640:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.831660:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.831662:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.831680:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.831687:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.831771:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.831774:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.831779:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.831788:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.831797:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.831800:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.831803:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.831805:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.831809:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.831811:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.831818:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.831839:0:81471:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1767317504.831846:0:81471:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:0.0:1767317504.831854:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767317504.831860:0:81471:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:0.0:1767317504.831863:0:81471:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:0.0:1767317504.831865:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000080:00200000:0.0:1767317504.832061:0:81471:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767317504.832070:0:81471:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1767317504.832074:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:0.0:1767317504.832088:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1767317504.832097:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767317504.832099:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x40000 00000080:00200000:0.0:1767317504.832107:0:81471:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:0.0:1767317504.832337:0:81471:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:0.0:1767317504.832406:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767317504.832409:0:81471:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1767317504.832420:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.832425:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.832427:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.832429:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.832432:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.832434:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.832640:0:81471:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1767317504.832648:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317504.832676:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e8b40 00000008:00100000:0.0:1767317504.832848:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9ed80 - object 0x2c0000400:191 offset 0<>4096 00000100:00100000:1.0:1767317504.832934:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661312:192.168.202.133@tcp:4:lfs.0 00000100:00100000:2.0:1767317504.837232:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.837327:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379175168 00000100:00100000:3.0:1767317504.837359:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379175168 00000100:00100000:3.0:1767317504.838149:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9445 00000100:00100000:3.0:1767317504.838166:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379175168:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.838190:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317504.838307:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.838315:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379175168:12345-192.168.202.133@tcp:104: Request processed in 156us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.838323:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9445 00010000:00010000:1.0:1767317504.838451:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.838460:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.838478:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317504.838485:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.838513:0:63743:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317504.838539:0:63743:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317504.838606:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.838614:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.838646:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.838655:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cf5f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71776 expref: -99 pid: 81467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.838681:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.838683:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.838685:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317504.838712:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317504.838730:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661440:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.847008:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661440:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.858340:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805041 gen 3 00000008:00010000:1.0:1767317504.858407:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e8b40 00000020:00200000:1.0:1767317504.858417:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767317504.858428:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767317504.858456:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e8b40 00000100:00100000:1.0:1767317504.858529:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661312:192.168.202.133@tcp:4:lfs.0 00000080:00200000:0.0:1767317504.858928:0:81471:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317504.858945:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.858951:0:81471:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:0.0:1767317504.858966:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:0.0:1767317504.858970:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.858981:0:81471:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:0.0:1767317504.859006:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317504.859016:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=1 00000080:00200008:0.0:1767317504.859025:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317504.859035:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317504.859074:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317504.859099:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.859116:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.859161:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317504.859171:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317504.859174:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:0.0:1767317504.859183:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:0.0:1767317504.859187:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.859196:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317504.859224:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767317504.859237:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.859241:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.859247:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.859270:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.859274:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.859293:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859304:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.859316:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.859320:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859327:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.859350:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.859356:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.859361:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.859365:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.859368:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.859373:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.859376:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.859384:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.859397:0:81471:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 4096, type: SEEK_DATA 00000080:00200000:0.0:1767317504.859403:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767317504.859408:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.859410:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317504.859416:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.859449:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:0.0:1767317504.859459:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317504.859465:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1767317504.859476:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317504.859481:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317504.859487:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 18446744073709551615] 00000008:00010000:0.0:1767317504.859494:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1767317504.859495:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x0 00010000:00010000:0.0:1767317504.859504:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859514:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859546:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859555:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859563:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317504.859576:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.859581:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.859595:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.859598:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767317504.859601:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859609:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767317504.859618:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.859620:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.859627:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.859635:0:81471:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null) 00000080:00200000:0.0:1767317504.859639:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767317504.859644:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317504.859651:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317504.859654:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317504.859661:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317504.859662:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x400000400001002 00010000:00010000:0.0:1767317504.859670:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859679:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.859686:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317504.859689:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317504.859708:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317504.859718:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317504.859723:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317504.859726:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317504.859728:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.859731:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317504.859734:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317504.859736:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317504.859743:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317504.859750:0:81471:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null), rc = 4096 00000080:00200080:0.0:1767317504.859757:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=0 00010000:00010000:2.0:1767317504.888151:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:1.0:1767317504.888352:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=2 00000080:00200008:1.0:1767317504.888369:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.888379:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.888408:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.888431:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.888459:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.888479:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.888489:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317504.888494:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfc8 00000080:00010000:1.0:1767317504.888503:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfc8 from it ffffa7f7c146bcd8 00010000:00010000:1.0:1767317504.888508:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.888525:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.888557:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:1.0:1767317504.888581:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.888584:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317504.888587:0:81471:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317504.888608:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317504.888611:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x400000400001002 00010000:00010000:1.0:1767317504.888628:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.888635:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.888646:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317504.888649:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.888654:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317504.888660:0:81471:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317504.888670:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.888673:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.888674:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.888676:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.888679:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.888681:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.888699:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.888730:0:81471:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 4096, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 4096, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000 00010000:00010000:1.0:1767317504.888757:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.888771:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.888815:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.888819:0:81471:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.888821:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442cfc8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a718a3 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317504.888841:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317504.888853:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291661696/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317504.888904:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291661696:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317504.889051:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.893009:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291661696:192.168.202.133@tcp:36:lfs.0 00000080:00200000:1.0:1767317504.893082:0:81471:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1767317504.893091:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1767317504.893116:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767317504.893146:0:81471:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317504.893166:0:81471:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317504.893179:0:81471:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c85b0, osc lock ffff8c3c60dd0850, flags 0x0 00010000:00010000:1.0:1767317504.893254:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.893290:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.893303:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317504.893329:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291661824:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.893427:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.897839:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291661824:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.897928:0:81471:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.897948:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.898279:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.898296:0:81471:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.898310:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.898319:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317504.898666:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661952:192.168.202.133@tcp:10:lfs.0 00000100:00100000:0.0:1767317504.904811:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291661952:192.168.202.133@tcp:10:lfs.0 00000080:00200000:1.0:1767317504.905029:0:81471:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317504.905288:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317504.905295:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317504.905301:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c85b0 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317504.905316:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317504.905330:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317504.905349:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317504.905353:0:81471:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c85b0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317504.905376:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.905392:0:81471:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 4096, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 4096, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000, rc 0 00000080:00200080:1.0:1767317504.905418:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=400866b1 arg=0 00000080:00200008:1.0:1767317504.905608:0:81471:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 4096, valid attrs 101f0, mode a7f7, uid 1108195440, gid -29636, new size 18446616789560194120, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000 00000020:00100000:1.0:1767317504.905794:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317504.905806:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291662208/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317504.905838:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662208:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317504.906611:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.911092:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662208:192.168.202.133@tcp:36:lfs.0 00000080:00200000:1.0:1767317504.911230:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1767317504.911249:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.911252:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.911262:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767317504.911373:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291662336:192.168.202.133@tcp:2:lfs.0 00000100:00100000:0.0:1767317504.915221:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291662336:192.168.202.133@tcp:2:lfs.0 00000080:00200000:1.0:1767317504.915316:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317504.915341:0:81471:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448) current size 4096, valid attrs 101f0, mode a7f7, uid 1108195440, gid -29636, new size 18446616789560194120, atime 1767317504.000000000, mtime 1767317504.000000000, ctime 1767317504.000000000, rc 0 00000080:00200080:1.0:1767317504.915374:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=21e22e0 00010000:00010000:1.0:1767317504.915613:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.915639:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442cfba lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71879 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.915667:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.915681:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.915686:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291662592/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.915812:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662592:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.916095:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 11 seconds 00000100:00100000:2.0:1767317504.920731:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317504.921252:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379175296 00000100:00100000:3.0:1767317504.921267:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379175296 00000100:00100000:3.0:1767317504.921340:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9446 00000100:00100000:3.0:1767317504.921351:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379175296:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317504.921372:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317504.921482:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317504.921489:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379175296:12345-192.168.202.133@tcp:104: Request processed in 141us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317504.921498:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9446 00010000:00010000:1.0:1767317504.921646:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317504.921655:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921665:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cec00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317504.921701:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921712:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921721:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.921765:0:64002:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767317504.921817:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921826:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.921866:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921909:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442cfc1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71895 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.921926:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.921929:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317504.921931:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.922012:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291662720:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.929724:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291662720:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.943255:0:81471:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937229 gen 1 00000100:00100000:1.0:1767317504.943297:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662592:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.943331:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9c700 x1853164291659904/t8589937224(8589937224) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317504.943368:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/138 (0 0) 00000080:00010000:1.0:1767317504.943379:0:81471:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:1.0:1767317504.943407:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317504.943480:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.943490:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.943502:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.943527:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662848:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.943625:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.946949:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291662848:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.947002:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947020:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317504.947349:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c1f80 x1853164291662848/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.947365:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317504.947381:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947397:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.947405:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317504.947427:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfdd 00000080:00010000:1.0:1767317504.947457:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfdd from it ffffa7f7c146bbc8 00010000:00010000:1.0:1767317504.947462:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947482:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947513:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947527:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.947537:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947583:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947590:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.947607:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.947621:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.947624:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.947632:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.947665:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317504.947679:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947699:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317504.947706:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.947723:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317504.947728:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317504.947730:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317504.947733:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317504.947741:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1767317504.947757:0:81471:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317504 1767317504 1767317503 by oinfo size 4096 blocks 8 [cma]time 1767317504 1767317504 1767317504 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317504.947794:0:81471:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 40960 blocks 80 [cma]time: 1767317504 1767317504 1767317503 by oinfo size 4096 blocks 8 [cma]time 1767317504 1767317504 1767317503 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317504.947854:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1767317504.947859:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.947868:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317504.948274:0:81471:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154002 00000002:00100000:1.0:1767317504.948337:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.948358:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.948364:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291663104/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.948393:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663104:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.948647:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.952689:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663104:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.952736:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2d80 x1853164291659008/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317504.952861:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.952969:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.952992:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.953007:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.953015:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.953022:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.953027:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.953035:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bbf8 00010000:00010000:1.0:1767317504.953120:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.953206:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.953247:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.953356:0:81471:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43db8d80, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1767317504.953366:0:81471:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:1.0:1767317504.953386:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0154401 00010000:00010000:1.0:1767317504.953447:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.953455:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317504.953477:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.953485:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291663360/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.953495:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.953519:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663360:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.953826:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.959716:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663360:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.959748:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959767:0:81471:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959776:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959807:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959818:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959832:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959840:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.959846:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.959856:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1f80 x1853164291663360/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.959869:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291663360/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.959904:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317504.959917:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.959927:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.959934:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317504.960007:0:81471:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 4096 00000080:00200000:1.0:1767317504.960011:0:81471:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff8c3c597df448): rc = 0 00000080:00200000:1.0:1767317504.960026:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767317504.960031:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfe4 00000080:00010000:1.0:1767317504.960054:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00200008:1.0:1767317504.960073:0:81471:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154400 00000002:00100000:1.0:1767317504.960104:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291663360/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317504.960182:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfe4 from it ffff8c3c432f8660 00010000:00010000:1.0:1767317504.960187:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.960195:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.960222:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 44 00000080:00200000:1.0:1767317504.960298:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317504.960307:0:81471:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), xattr lov 00000080:00200008:1.0:1767317504.960334:0:81471:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317504.960341:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317504.960364:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.960374:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.960386:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317504.960392:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.960403:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317504.960407:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfe4 00000080:00010000:1.0:1767317504.960411:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfe4 from it ffffa7f7c146bcd8 00010000:00010000:1.0:1767317504.960415:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317504.960422:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317504.960464:0:81471:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154000 00000002:00100000:1.0:1767317504.960525:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291663360/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317504.960537:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317504.960543:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2d80 x1853164291663616/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317504.960569:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663616:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317504.960685:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 11 seconds 00000100:00100000:1.0:1767317504.964487:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663616:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317504.964536:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291663360/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 768/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317504.964649:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317504.964674:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317504.964696:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.964711:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.964740:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317504.964747:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317504.964751:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317504.964760:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bbf8 00010000:00010000:1.0:1767317504.964764:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.964773:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317504.964791:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317504.964799:0:81471:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767317504.964807:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 46 00000080:00200008:1.0:1767317504.964820:0:81471:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154402 00000002:00010000:1.0:1767317504.964840:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1767317504.965332:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.965344:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317504.965358:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.965368:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2d80 x1853164291663872/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.965378:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.965405:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663872:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317504.965682:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:2.0:1767317504.970032:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317504.970098:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317504.970118:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379175680 00000100:00100000:2.0:1767317504.970137:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379175680 00000100:00100000:2.0:1767317504.970647:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9447 00000100:00100000:2.0:1767317504.970663:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379175680:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317504.970686:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317504.970829:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317504.970837:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379175680:12345-192.168.202.133@tcp:104: Request processed in 181us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317504.970844:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9447 00010000:00010000:0.0:1767317504.972393:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317504.972407:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972421:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317504.972427:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972437:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972449:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972494:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972557:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972562:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317504.972617:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972629:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442cfe4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718f7 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317504.972645:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.972646:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317504.972648:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317504.972661:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317504.972681:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317504.977457:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317504.977643:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291663872:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317504.977671:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977692:0:81471:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977701:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977714:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977727:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977742:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977751:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977759:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.977771:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c2d80 x1853164291663872/t8589937233(8589937233) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317504.977810:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2d80 x1853164291663872/t8589937233(8589937233) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317504.977828:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977840:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317504.977848:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317504.977962:0:81471:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 4096 00000080:00010000:1.0:1767317504.977970:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cfeb 00000080:00010000:1.0:1767317504.977978:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cfeb from it ffffa7f7c146bbf0 00010000:00010000:1.0:1767317504.977983:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.977991:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317504.978027:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2d80 x1853164291663872/t8589937233(8589937233) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767317504.978156:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=800466af arg=7fff6eefbefc 00000080:00200080:1.0:1767317504.978174:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=80086601 arg=7fff6eefbe98 00000100:00100000:1.0:1767317504.978230:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664128:192.168.202.133@tcp:33:lfs.0 00000100:00100000:1.0:1767317504.978324:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317504.984630:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664128:192.168.202.133@tcp:33:lfs.0 00000080:00200080:1.0:1767317504.984713:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=7fff6eefbe84 00000002:00010000:1.0:1767317504.984755:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000002 00010000:00010000:1.0:1767317504.984796:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.984927:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.984935:0:81471:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317504.984939:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442cfeb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7190c expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317504.984980:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317504.984988:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317504.985001:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317504.985012:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291664384/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317504.985023:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317504.985049:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664384:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317504.985680:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317504.992651:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664384:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317504.992685:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.992795:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.992808:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.992819:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.992834:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.992865:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.993460:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.993483:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c1f80 x1853164291664384/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317504.993496:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291664384/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317504.993514:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.993531:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317504.993539:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317504.993567:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291664384/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317504.993578:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cff2 00000080:00010000:0.0:1767317504.993586:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cff2 from it ffffa7f7c146bcc0 00010000:00010000:0.0:1767317504.993589:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.993595:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000080:00200080:0.0:1767317504.993679:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=21e2430 00010000:00010000:0.0:1767317504.994209:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317504.994229:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442cff2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71921 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317504.994249:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291664384/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317504.994260:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317504.994266:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d180 x1853164291664640/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317504.994293:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664640:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317504.994464:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1767317505.001405:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317505.001453:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317505.001500:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379175808 00000100:00100000:2.0:1767317505.001514:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379175808 00000100:00100000:2.0:1767317505.001571:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379175936 00000100:00100000:2.0:1767317505.001574:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379175936 00000100:00100000:2.0:1767317505.001592:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9448 00000100:00100000:2.0:1767317505.001602:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:51018:x1853164379175808:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317505.001628:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1767317505.001826:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9449 00000100:00100000:3.0:1767317505.001837:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:51018:x1853164379175936:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317505.001847:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317505.002138:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317505.002147:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:51018:x1853164379175808:12345-192.168.202.133@tcp:104: Request processed in 546us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317505.002156:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9448 00010000:00010000:1.0:1767317505.007099:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1767317505.007119:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007216:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317505.007223:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007261:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007272:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.007304:0:42098:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767317505.007367:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007374:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317505.007478:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664768:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317505.007619:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007628:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cfdd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a718db expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.007649:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317505.007653:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.007660:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cf200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317505.007663:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.007670:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.007676:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.007813:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.007821:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317505.011548:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317505.011568:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317505.011593:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664896:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317505.012378:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.012396:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442cf82 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a717e6 expref: -99 pid: 81468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.012423:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317505.012425:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317505.012427:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317505.012497:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1767317505.012530:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379175936:12345-192.168.202.133@tcp:104: Request processed in 10691us (11072us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317505.012543:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9449 00000100:00100000:1.0:1767317505.019478:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291664640:192.168.202.133@tcp:35:lfs.0 00000080:00020000:1.0:1767317505.019504:0:81471:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff8c3c49ba6000: inode [0x200000405:0x8a:0x0] mdc close failed: rc = -22 00000100:00100000:0.0:1767317505.024301:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664768:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317505.024346:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291664896:192.168.202.133@tcp:103:ldlm_bl.0 00000002:00100000:1.0:1767317505.029384:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291664384/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317505.029451:0:81471:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:1.0:1767317505.029476:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317505.029552:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.029563:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.029574:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317505.029602:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665024:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317505.030383:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317505.036490:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665024:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317505.036535:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.036553:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317505.036569:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c1f80 x1853164291665024/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317505.036581:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317505.036598:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.036613:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317505.036621:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317505.037075:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442cff9 00000080:00010000:1.0:1767317505.037088:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cff9 from it ffffa7f7c146bbc8 00010000:00010000:1.0:1767317505.037094:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.037105:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.037282:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.037326:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317505.037335:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.037393:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1767317505.037398:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.037406:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.038344:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317505.038375:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317505.038389:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038401:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.038409:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317505.038418:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317505.038422:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317505.038427:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bbf8 00010000:00010000:1.0:1767317505.038431:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038453:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.038475:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317505.038496:0:81471:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317505.038504:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317505.038510:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038519:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.038525:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317505.038529:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317505.038532:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442cf90 00000080:00010000:1.0:1767317505.038535:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cf90 from it ffffa7f7c146bb38 00010000:00010000:1.0:1767317505.038538:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038545:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.038552:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317505.038558:0:81471:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=. :VOLATILE:0000:31A7C5E4:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43db8d80, open_flags 2f9c2, mode 8180 opened 0 00000080:00200000:1.0:1767317505.038566:0:81471:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=. :VOLATILE:0000:31A7C5E4:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:1.0:1767317505.038592:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: . :VOLATILE:0000:31A7C5E4:fd=03,[0x200000405:0x8d:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0574703 00010000:00010000:1.0:1767317505.038614:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038806:0:81471:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038814:0:81471:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317505.038817:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442cf90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71810 expref: -99 pid: 81469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.038868:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.039070:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317505.039084:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317505.039099:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291665280/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317505.039109:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317505.039147:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665280:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317505.039352:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317505.048914:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665280:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317505.048949:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.048998:0:81471:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049030:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049042:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049053:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049067:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049075:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049083:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317505.049094:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8c3c437c1f80 x1853164291665280/t8589937236(8589937236) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317505.049107:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291665280/t8589937236(8589937236) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317505.049120:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049145:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/141 (0 0) 00000080:00200000:1.0:1767317505.049153:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317505.049176:0:81471:0:(namei.c:1569:ll_create_it()) VFS Op:name=. :VOLATILE:0000:31A7C5E4:fd=03, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000080:00200000:1.0:1767317505.049210:0:81471:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8d:0x0](ffff8c3c61723248) 00000080:00200000:1.0:1767317505.049219:0:81471:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8d:0x0], updating i_size 0 00000080:00200000:1.0:1767317505.049261:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8d:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1767317505.049267:0:81471:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8d:0x0](ffff8c3c61723248) 00000080:00010000:1.0:1767317505.049271:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8d:0x0](ffff8c3c61723248) for lock 0x73c3d5cb1442d000 00000080:00010000:1.0:1767317505.049282:0:81471:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8d:0x0](ffff8c3c61723248) 00000080:00200008:1.0:1767317505.049301:0:81471:0:(file.c:1001:ll_file_open()) START file . :VOLATILE:0000:31A7C5E4:fd=03:[0x200000405:0x8d:0x0](ffff8c3c61723248), flags 574702 00000002:00100000:1.0:1767317505.049325:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291665280/t8589937236(8589937236) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317505.049365:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d000 from it ffff8c3c432f8660 00010000:00010000:1.0:1767317505.049369:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.049378:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.049404:0:81471:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8d:0x0](ffff8c3c61723248), inode mode 8180 mask 40 00000080:00200080:1.0:1767317505.049432:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=7fff6eefbe84 00000002:00010000:1.0:1767317505.049456:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000002 00010000:00010000:1.0:1767317505.049532:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.049539:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000020:00100000:1.0:1767317505.049552:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317505.049558:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3b80 x1853164291665536/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317505.049573:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317505.049598:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665536:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317505.049825:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317505.057728:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665536:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317505.057763:0:81471:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057777:0:81471:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057793:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057807:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057821:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057829:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057837:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317505.057851:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c3b80 x1853164291665536/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317505.057907:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3b80 x1853164291665536/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317505.057926:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.057944:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317505.057952:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767317505.057993:0:81471:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3b80 x1853164291665536/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317505.058001:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d007 00000080:00010000:1.0:1767317505.058009:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d007 from it ffffa7f7c146bcc0 00010000:00010000:1.0:1767317505.058013:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.058021:0:81471:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000080:00200080:1.0:1767317505.058100:0:81471:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) cmd=c00c66f3 arg=21e2450 00010000:00010000:1.0:1767317505.058175:0:81471:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.058190:0:81471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d007 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71959 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317505.058207:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c3b80 x1853164291665536/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317522 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317505.058233:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317505.058239:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291665792/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317505.058268:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665792:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317505.058380:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 11 seconds 00000080:00200000:3.0:1767317505.058644:0:8441:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x86:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317505.058663:0:8441:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317505.058738:0:8441:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x86:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:2.0:1767317505.061707:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317505.061850:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379176064 00000100:00100000:3.0:1767317505.061863:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379176064 00000100:00100000:3.0:1767317505.061983:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9450 00000100:00100000:3.0:1767317505.061996:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379176064:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317505.062019:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317505.062106:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317505.062114:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379176064:12345-192.168.202.133@tcp:104: Request processed in 120us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317505.062121:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9450 00010000:00010000:0.0:1767317505.062285:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317505.062294:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062304:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317505.062310:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062341:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062350:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317505.062380:0:63742:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767317505.062430:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062438:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317505.062479:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062487:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442cff9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71936 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.062512:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317505.062515:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317505.062517:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317505.062528:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317505.062547:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291665920:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317505.066595:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317505.066679:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379176192 00000100:00100000:3.0:1767317505.066692:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379176192 00000100:00100000:3.0:1767317505.066758:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9451 00000100:00100000:3.0:1767317505.066770:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379176192:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317505.066791:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317505.066915:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317505.066923:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379176192:12345-192.168.202.133@tcp:104: Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317505.066954:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9451 00010000:00010000:1.0:1767317505.066993:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317505.067002:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.067012:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317505.067017:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.067027:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.067036:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.067069:0:63276:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8d:0x0]: losing layout lock 00010000:00010000:1.0:1767317505.067123:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.067142:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317505.067165:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.067182:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d000 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71944 expref: -99 pid: 81471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317505.067197:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291666048:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317505.067213:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317505.067215:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317505.067216:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317505.067301:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291665920:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317505.088149:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291666048:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317505.098370:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291665792:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317505.098419:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c3b80 x1853164291665536/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317505.098485:0:81471:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000002:00010000:1.0:1767317505.098498:0:81471:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317505.098564:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.098574:0:81471:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00010000:00010000:1.0:1767317505.098585:0:81471:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81471 initiator: MDT0 00000100:00100000:1.0:1767317505.098607:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666176:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317505.098717:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317505.102247:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666176:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317505.102285:0:81471:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102302:0:81471:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317505.102317:0:81471:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c1180 x1853164291666176/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/480 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317505.102346:0:81471:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317505.102360:0:81471:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102377:0:81471:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317505.102384:0:81471:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317505.102405:0:81471:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d00e 00000080:00010000:1.0:1767317505.102415:0:81471:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d00e from it ffffa7f7c146bbc8 00010000:00010000:1.0:1767317505.102420:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102429:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102491:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102505:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317505.102515:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102560:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102568:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.102592:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317505.102605:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317505.102609:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317505.102616:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317505.102650:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317505.102664:0:81471:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102672:0:81471:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317505.102679:0:81471:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](0000000016877553) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.102695:0:81471:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317505.102700:0:81471:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317505.102702:0:81471:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317505.102705:0:81471:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317505.102714:0:81471:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.102786:0:81471:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1767317505.102791:0:81471:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.102798:0:81471:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317505.102838:0:81471:0:(file.c:424:ll_file_release()) START file . :VOLATILE:0000:31A7C5E4:fd=03:[0x200000405:0x8d:0x0](ffff8c3c61723248), flags 554002 00000002:00100000:1.0:1767317505.103001:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291665280/t8589937236(8589937236) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317522 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317505.103019:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317505.103025:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291666432/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317505.103053:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666432:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317505.103162:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c58c6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1767317505.106989:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666432:192.168.202.133@tcp:35:lfs.0 00000002:00100000:3.0:1767317505.107035:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291665280/t8589937236(8589937236) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 552/608 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767317505.107109:0:81471:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 154002 00000002:00100000:3.0:1767317505.107188:0:81471:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2d80 x1853164291663872/t8589937233(8589937233) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317505.107200:0:81471:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317505.107205:0:81471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3480 x1853164291666688/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317505.107232:0:81471:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666688:192.168.202.133@tcp:35:lfs.0 00000100:00100000:3.0:1767317505.107317:0:81471:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1767317505.110037:0:81471:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81471:1853164291666688:192.168.202.133@tcp:35:lfs.0 00000002:00100000:3.0:1767317505.110075:0:81471:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2d80 x1853164291663872/t8589937233(8589937233) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317521 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317505.125862:0:81472:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317505.125936:0:81472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317505.126135:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81472 initiator: MDT0 00010000:00010000:2.0:1767317505.126154:0:81472:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81472 initiator: MDT0 00010000:00010000:2.0:1767317505.126165:0:81472:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81472 initiator: MDT0 00000100:00100000:2.0:1767317505.126199:0:81472:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81472:1853164291666816:192.168.202.133@tcp:101:ls.0 00000100:00100000:2.0:1767317505.126328:0:81472:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5474bf00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317505.133547:0:81472:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81472:1853164291666816:192.168.202.133@tcp:101:ls.0 00010000:00010000:0.0:1767317505.133595:0:81472:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133610:0:81472:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133623:0:81472:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133636:0:81472:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133649:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133658:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133666:0:81472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317505.133678:0:81472:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38000 x1853164291666816/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317505.133693:0:81472:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133708:0:81472:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317505.133716:0:81472:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317505.133750:0:81472:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317505.133764:0:81472:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:0.0:1767317505.133773:0:81472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317505.133776:0:81472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1483b58 00010000:00010000:0.0:1767317505.133779:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.133788:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317505.133819:0:81472:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317505.133847:0:81472:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317505.133852:0:81472:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317505.133910:0:81472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317505.133976:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81472 initiator: MDT0 00010000:00010000:0.0:1767317505.133983:0:81472:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81472 initiator: MDT0 00010000:00010000:0.0:1767317505.133993:0:81472:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81472 initiator: MDT0 00000100:00100000:0.0:1767317505.134017:0:81472:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81472:1853164291666944:192.168.202.133@tcp:101:ls.0 00000100:00100000:0.0:1767317505.134118:0:81472:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5a1ca000 going to sleep for 12 seconds 00000100:00100000:0.0:1767317505.148106:0:81472:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ls:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81472:1853164291666944:192.168.202.133@tcp:101:ls.0 00010000:00010000:0.0:1767317505.148156:0:81472:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148178:0:81472:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148206:0:81472:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148219:0:81472:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148233:0:81472:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148248:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148257:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148266:0:81472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317505.148279:0:81472:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291666944/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/720 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317505.148292:0:81472:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317505.148309:0:81472:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.148322:0:81472:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767317505.148332:0:81472:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317505.148402:0:81472:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff8c3c597df448): rc = 0 00000080:00200000:0.0:1767317505.148419:0:81472:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1767317505.148425:0:81472:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d01c 00000080:00010000:0.0:1767317505.148448:0:81472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317505.148452:0:81472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d01c from it ffffa7f7c1483b20 00010000:00010000:0.0:1767317505.148456:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.148474:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317505.148527:0:81472:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 606, flags 0, foreign 0 00000080:00200000:0.0:1767317505.148536:0:81472:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:0.0:1767317505.148568:0:81472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317505.148577:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.148589:0:81472:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317505.148596:0:81472:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317505.148601:0:81472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:0.0:1767317505.148605:0:81472:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d01c 00000080:00010000:0.0:1767317505.148608:0:81472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d01c from it ffffa7f7c1483cb8 00010000:00010000:0.0:1767317505.148611:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317505.148618:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317505.148664:0:81472:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00000001:00010000:0.0:1767317505.148677:0:81472:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767317505.148702:0:81472:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317505.148707:0:81472:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x400001002 00010000:00010000:0.0:1767317505.148727:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317505.148738:0:81472:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317505.148753:0:81472:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317505.148766:0:81472:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317505.148770:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317505.148778:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317505.148789:0:81472:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317505.148803:0:81472:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767317505.148808:0:81472:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:0.0:1767317505.148811:0:81472:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317505.148815:0:81472:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317505.148820:0:81472:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317505.148829:0:81472:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317505.148842:0:81472:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317505.148970:0:81472:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317505.148980:0:81472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317505.148988:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.148996:0:81472:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317505.149002:0:81472:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317505.149007:0:81472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317505.149009:0:81472:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:0.0:1767317505.149012:0:81472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1483bf8 00010000:00010000:0.0:1767317505.149016:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.149022:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317505.149030:0:81472:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317505.149038:0:81472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200000:0.0:1767317505.149068:0:81472:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317505.149076:0:81472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317505.149082:0:81472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.149091:0:81472:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317505.149111:0:81472:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317505.149115:0:81472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317505.149118:0:81472:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:0.0:1767317505.149122:0:81472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1483bf8 00010000:00010000:0.0:1767317505.149126:0:81472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317505.149134:0:81472:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317505.149143:0:81472:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317505.149147:0:81472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00000080:00200000:1.0:1767317505.163599:0:81473:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317505.163646:0:81473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317505.163669:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.163689:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.163697:0:81473:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317505.163707:0:81473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317505.163711:0:81473:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317505.163719:0:81473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1cbfbf8 00010000:00010000:1.0:1767317505.163723:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.163732:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317505.163752:0:81473:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317505.163763:0:81473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767317505.163769:0:81473:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448), inode mode 81a4 mask 44 00000080:00200008:1.0:1767317505.163776:0:81473:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 100000 00000002:00010000:1.0:1767317505.163804:0:81473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100001 00010000:00010000:1.0:1767317505.163905:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81473 initiator: MDT0 00010000:00010000:1.0:1767317505.163914:0:81473:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81473 initiator: MDT0 00000020:00100000:1.0:1767317505.163928:0:81473:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317505.163945:0:81473:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3b80 x1853164291667200/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317505.164122:0:81473:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81473 initiator: MDT0 00000100:00100000:1.0:1767317505.164150:0:81473:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job md5sum:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81473:1853164291667200:192.168.202.133@tcp:101:md5sum.0 00000100:00100000:1.0:1767317505.164409:0:81473:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c58c6a480 going to sleep for 12 seconds 00000100:00100000:1.0:1767317505.167783:0:81473:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job md5sum:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81473:1853164291667200:192.168.202.133@tcp:101:md5sum.0 00010000:00010000:1.0:1767317505.167827:0:81473:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.167840:0:81473:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.167854:0:81473:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317505.167866:0:81473:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317505.167912:0:81473:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317505.167945:0:81473:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317505.167971:0:81473:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317505.167985:0:81473:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.167997:0:81473:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767317505.168005:0:81473:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317505.168067:0:81473:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767317505.168072:0:81473:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d023 00000080:00010000:1.0:1767317505.168080:0:81473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d023 from it ffffa7f7c1cbfbf0 00010000:00010000:1.0:1767317505.168085:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.168096:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317505.168131:0:81473:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317522 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317505.168565:0:81473:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317505.168575:0:81473:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317505.168602:0:81473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317505.168613:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.168637:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.168645:0:81473:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317505.168651:0:81473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317505.168656:0:81473:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d01c 00000080:00010000:1.0:1767317505.168661:0:81473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d01c from it ffffa7f7c1cbfcd8 00010000:00010000:1.0:1767317505.168664:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317505.168672:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317505.168692:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00000001:00010000:1.0:1767317505.168704:0:81473:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317505.168729:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317505.168732:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0850, flags 0x400001002 00010000:00010000:1.0:1767317505.168752:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.168762:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.168775:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317505.168780:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.168799:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.168811:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317505.168822:0:81473:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317505.168826:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.168830:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.168833:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.168837:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.168840:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317505.168851:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317505.168923:0:81473:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 32768 00000080:00200000:1.0:1767317505.168931:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767317505.168938:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.168943:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767317505.168947:0:81473:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317505.170601:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317505.170612:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0850, flags 0x400001002 00010000:00010000:1.0:1767317505.170640:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.170659:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.170674:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317505.170697:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.170709:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.170726:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317505.170737:0:81473:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317505.170742:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.170746:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.170751:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.170755:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.170758:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317505.170771:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.170781:0:81473:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 32768] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767317505.170822:0:81473:0:(rw.c:2016:ll_readpage()) fast read pgno: 0 00000080:00200000:1.0:1767317505.170838:0:81473:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:1.0:1767317505.170844:0:81473:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767317505.170854:0:81473:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 1, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767317505.170857:0:81473:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 0 0 00000080:00200000:1.0:1767317505.170861:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317505.171333:0:81473:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767317505.171338:0:81473:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317505.171356:0:81473:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767317505.171371:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317505.171376:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0850, flags 0x0 00010000:00010000:1.0:1767317505.171390:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.171401:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.171421:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.171429:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.171539:0:81473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317505.171550:0:81473:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:1.0:1767317505.171566:0:81473:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000008:00010000:1.0:1767317505.171620:0:81473:0:(osc_cache.c:2941:osc_queue_sync_pages()) ### no dlm lock: extent: ffff8c3c5a319180 00000008:00010000:1.0:1767317505.171673:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319180 00010000:00010000:1.0:1767317505.171701:0:77461:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000008:00100000:1.0:1767317505.171750:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c1500 - object 0x2c0000400:191 offset 0<>4096 00000100:00100000:0.0:1767317505.171832:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291667328:192.168.202.133@tcp:3:md5sum.0 00000008:00010000:0.0:1767317505.177399:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319180 00000020:00200000:0.0:1767317505.177423:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317505.177715:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319180 00000100:00100000:0.0:1767317505.177752:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291667328:192.168.202.133@tcp:3:md5sum.0 00000020:00010000:1.0:1767317505.178093:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.178098:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.178103:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317505.178116:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178330:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317505.178367:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.178371:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317505.178381:0:81473:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000080:00200000:1.0:1767317505.178394:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.178400:0:81473:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767317505.178407:0:81473:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200008:1.0:1767317505.178430:0:81473:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 24576 00000080:00200000:1.0:1767317505.178528:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767317505.178550:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.178556:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00000001:00010000:1.0:1767317505.178561:0:81473:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317505.178579:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317505.178584:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0850, flags 0x400001002 00010000:00010000:1.0:1767317505.178608:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178622:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.178635:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317505.178638:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178646:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.178668:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317505.178678:0:81473:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317505.178682:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.178685:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.178688:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.178691:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.178694:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317505.178701:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.178705:0:81473:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [4096, 28672] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767317505.178742:0:81473:0:(rw.c:2016:ll_readpage()) fast read pgno: 1 00000080:00200000:1.0:1767317505.178749:0:81473:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 4096, bytes: 24576 00000080:00200000:1.0:1767317505.178755:0:81473:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767317505.178764:0:81473:0:(cl_io.c:214:cl_io_rw_init()) header@00000000491015c3[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767317505.178767:0:81473:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [4096, 28672) 0 0 00000080:00200000:1.0:1767317505.178770:0:81473:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317505.178783:0:81473:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 28672) 28672, 24576 00020000:00200000:1.0:1767317505.178788:0:81473:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317505.178802:0:81473:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 6] 00000008:00010000:1.0:1767317505.178811:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317505.178815:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0850, flags 0x0 00010000:00010000:1.0:1767317505.178824:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178833:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 28671) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178842:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178861:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.178950:0:81473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317505.179059:0:81473:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [4096, 28672) 00000001:00010000:1.0:1767317505.179072:0:81473:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317505.179078:0:81473:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317505.179080:0:81473:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8230, osc lock ffff8c3c60dd1560, flags 0x400001002 00010000:00010000:1.0:1767317505.179354:0:81473:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.179364:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.179372:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317505.179376:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 7/1,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.179383:0:81473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 6/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317505.179388:0:81473:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317505.179393:0:81473:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317505.179396:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.179405:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.179408:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8230 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.179411:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.179414:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8230 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.179423:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317505.179426:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317505.179428:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317505.179432:0:81473:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317505.179535:0:81473:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317505.179545:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61f38 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317505.179548:0:81473:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317505.179554:0:81473:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000080:00200000:1.0:1767317505.179561:0:81473:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317505.179565:0:81473:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000080:00200000:1.0:1767317505.179567:0:81473:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200008:1.0:1767317505.179598:0:81473:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR 00000080:00200008:1.0:1767317505.179605:0:81473:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR, rc = 4096 00000080:00200008:1.0:1767317505.179627:0:81473:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), flags 100000 00010000:00010000:1.0:1767317505.179655:0:81473:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317505.897524:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317506.914038:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317507.618725:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.619003:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.619042:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1767317507.619049:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291667456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.619078:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.619104:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667968:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.633009:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.633053:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291667456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.633069:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.633082:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667968:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317507.633096:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291667584:192.168.202.133@tcp:400:kworker.0 00010000:00010000:1.0:1767317507.938958:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317508.963496:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317509.993927:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317511.010152:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317511.288036:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317511.288100:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379179136 00000100:00100000:3.0:1767317511.288121:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379179136 00000100:00100000:3.0:1767317511.288188:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9452 00000100:00100000:3.0:1767317511.288202:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19290:x1853164379179136:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317511.288228:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317511.288341:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317511.288349:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19290:x1853164379179136:12345-192.168.202.133@tcp:104: Request processed in 151us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317511.288357:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9452 00010000:00010000:1.0:1767317511.288553:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317511.288569:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317511.288580:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce400 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317511.288588:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317511.288651:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317511.288659:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317511.288688:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317511.288696:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442cfcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718aa expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317511.288723:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317511.288725:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317511.288726:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317511.288744:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291668096:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317511.293915:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291668096:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317512.033107:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767317512.616627:0:82037:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 212a: Testing lfs setstripe --comp-set --comp-flags=stale --mirror-id ========================================================== 20:31:51 (1767317511) 00000080:00200000:1.0:1767317512.686857:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.686926:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.686949:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.686979:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.686989:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.686998:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.687003:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.687011:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47b58 00010000:00010000:1.0:1767317512.687016:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.687026:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.687047:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317512.687064:0:82040:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=13 00000080:00200000:1.0:1767317512.687069:0:82040:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317512.687086:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.687152:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.687160:0:82040:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.687171:0:82040:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00000100:00100000:1.0:1767317512.687206:0:82040:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668224:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.692412:0:82040:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78b40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.707247:0:82040:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937244 gen 1 00000100:00100000:1.0:1767317512.707302:0:82040:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317522 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317512.707317:0:82040:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668224:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317512.707336:0:82040:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707350:0:82040:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707357:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707364:0:82040:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707372:0:82040:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707378:0:82040:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317512.707384:0:82040:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707390:0:82040:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707408:0:82040:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707416:0:82040:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317512.707423:0:82040:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.707446:0:82040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d02a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82040 initiator: MDT0 00000002:00100000:1.0:1767317512.707466:0:82040:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8c3c437c3480 x1853164291668224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/584 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317512.707482:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1767317512.707516:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.707529:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317512.707538:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47940 00010000:00010000:1.0:1767317512.707543:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.707551:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.709792:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.709824:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.709844:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.709860:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.709868:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.712046:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.712061:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.712076:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47be8 00010000:00010000:1.0:1767317512.712084:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.712099:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.712122:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317512.712134:0:82040:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=16392 00000080:00200008:1.0:1767317512.712182:0:82040:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1767317512.712188:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.712210:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.712226:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.712238:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.712246:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.712251:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.712254:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.712258:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47cb8 00010000:00010000:1.0:1767317512.712260:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.712268:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317512.714253:0:82040:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1767317512.714267:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.714296:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.714319:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.714336:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.714345:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.714355:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.714359:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.714367:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47cb8 00010000:00010000:1.0:1767317512.714371:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.714380:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.714558:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.716576:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.716606:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716625:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716634:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.716652:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.716657:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.716667:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47b58 00010000:00010000:1.0:1767317512.716672:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716681:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716700:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317512.716711:0:82040:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=8 00000080:00200000:1.0:1767317512.716752:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.716761:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.716767:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716776:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716783:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.716787:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.716790:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.716794:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47bf8 00010000:00010000:1.0:1767317512.716797:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716804:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716813:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317512.716826:0:82040:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=777 00000080:00200000:1.0:1767317512.716830:0:82040:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.716838:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.716844:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716853:0:82040:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716859:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.716863:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.716866:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d015 00000080:00010000:1.0:1767317512.716898:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d015 from it ffffa7f7c1d47b38 00010000:00010000:1.0:1767317512.716902:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.716910:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.716919:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317512.716925:0:82040:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c50946c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1767317512.716938:0:82040:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:1.0:1767317512.716963:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1767317512.716979:0:82040:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.717049:0:82040:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.717072:0:82040:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.717076:0:82040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d015 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7198a expref: -99 pid: 81472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.717125:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.717132:0:82040:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00000020:00100000:1.0:1767317512.717145:0:82040:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317512.717161:0:82040:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3480 x1853164291668480/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317512.717172:0:82040:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00000100:00100000:1.0:1767317512.717199:0:82040:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668480:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.717384:0:82040:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78b40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.725032:0:82040:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668480:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317512.725067:0:82040:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725101:0:82040:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725128:0:82040:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725141:0:82040:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725154:0:82040:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725172:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725181:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725188:0:82040:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317512.725201:0:82040:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8c3c437c3480 x1853164291668480/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317512.725215:0:82040:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3480 x1853164291668480/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317512.725230:0:82040:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725243:0:82040:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767317512.725251:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317512.725273:0:82040:0:(namei.c:1569:ll_create_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000080:00200000:0.0:1767317512.725309:0:82040:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00200000:0.0:1767317512.725316:0:82040:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 0 00000080:00200000:0.0:1767317512.725358:0:82040:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1767317512.725364:0:82040:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:0.0:1767317512.725368:0:82040:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d031 00000080:00010000:0.0:1767317512.725380:0:82040:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00200008:0.0:1767317512.725407:0:82040:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 120501 00000002:00100000:0.0:1767317512.725431:0:82040:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3480 x1853164291668480/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317512.725474:0:82040:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d031 from it ffff8c3c432f8300 00010000:00010000:0.0:1767317512.725479:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.725487:0:82040:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.725513:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 40 00000080:00200000:0.0:1767317512.725580:0:82040:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 2 00000080:00200000:0.0:1767317512.725592:0:82040:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000002:00010000:0.0:1767317512.725613:0:82040:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1767317512.725679:0:82040:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82040 initiator: MDT0 00010000:00010000:0.0:1767317512.725686:0:82040:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00000020:00100000:0.0:1767317512.725699:0:82040:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317512.725706:0:82040:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291668736/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317512.725721:0:82040:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00000100:00100000:0.0:1767317512.725744:0:82040:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668736:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317512.726002:0:82040:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0c00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317512.728956:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317512.729048:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379179264 00000100:00100000:2.0:1767317512.729063:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379179264 00000100:00100000:2.0:1767317512.729131:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9453 00000100:00100000:2.0:1767317512.729145:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15478:x1853164379179264:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317512.729167:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317512.729261:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317512.729269:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15478:x1853164379179264:12345-192.168.202.133@tcp:104: Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317512.729278:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9453 00010000:00010000:1.0:1767317512.730362:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317512.730376:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730389:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317512.730404:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730415:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730437:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.730472:0:63276:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317512.730537:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730544:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.730586:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730594:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d031 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a719f3 expref: -99 pid: 82040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.730612:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.730614:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.730616:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317512.730648:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291668864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317512.737708:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291668864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317512.738178:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2518:1853164291668992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.738285:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.738318:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767317512.738324:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.738351:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.738939:0:82040:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291668736:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317512.738958:0:82040:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.738975:0:82040:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.738983:0:82040:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.738991:0:82040:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739001:0:82040:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739008:0:82040:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cf000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317512.739013:0:82040:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739021:0:82040:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739030:0:82040:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739038:0:82040:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317512.739045:0:82040:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82040 initiator: MDT0 00010000:00010000:1.0:1767317512.739052:0:82040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82040 initiator: MDT0 00000002:00100000:1.0:1767317512.739096:0:82040:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8c3c50e9ca80 x1853164291668736/t8589937246(8589937246) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317512.739109:0:82040:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291668736/t8589937246(8589937246) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317512.739137:0:82040:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317512.739194:0:82040:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317512.739205:0:82040:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317512.739261:0:82040:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 0 00000002:00100000:1.0:1767317512.739280:0:82040:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291668736/t8589937246(8589937246) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317512.739317:0:82040:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9ca80 x1853164291668736/t8589937246(8589937246) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317512.739328:0:82040:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317512.739333:0:82040:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291669632/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317512.739354:0:82040:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291669632:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317512.739418:0:82040:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317512.748093:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2518:1853164291668992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.752343:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.752363:0:2518:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179875995 gen 2 00000100:00100000:1.0:1767317512.752382:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317512.752418:0:2518:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805042 gen 3 00000100:00100000:1.0:1767317512.752429:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291669248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317512.752937:0:82040:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291669632:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317512.752988:0:82040:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9ca80 x1853164291668736/t8589937246(8589937246) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317512.753080:0:82040:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 100001 00000002:00100000:0.0:1767317512.753156:0:82040:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c3480 x1853164291668480/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317512.753178:0:82040:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317512.753185:0:82040:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e680 x1853164291669888/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317512.753213:0:82040:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291669888:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317512.753306:0:82040:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317512.757243:0:82040:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82040:1853164291669888:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317512.757292:0:82040:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c3480 x1853164291668480/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317512.758853:0:81905:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317512.758913:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317512.759006:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81905 initiator: MDT0 00010000:00010000:3.0:1767317512.759018:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00010000:00010000:3.0:1767317512.759030:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000100:00100000:3.0:1767317512.759143:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670016:192.168.202.133@tcp:101:bash.0 00000100:00100000:3.0:1767317512.759249:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.768055:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670016:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317512.768159:0:81905:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768173:0:81905:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768189:0:81905:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768204:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768216:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768225:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768232:0:81905:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317512.768244:0:81905:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc0380 x1853164291670016/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.768260:0:81905:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768287:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317512.768295:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317512.768329:0:81905:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317512.768337:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d03f 00000080:00010000:1.0:1767317512.768344:0:81905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.768347:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d03f from it ffffa7f7c0e3bbf8 00010000:00010000:1.0:1767317512.768350:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768360:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.768391:0:81905:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317512.768440:0:81905:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317512.768462:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.768471:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768483:0:81905:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.768490:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317512.768496:0:81905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317512.768499:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d03f 00000080:00010000:1.0:1767317512.768502:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d03f from it ffffa7f7c0e3bb38 00010000:00010000:1.0:1767317512.768505:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768523:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.768532:0:81905:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317512.768538:0:81905:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43aefc80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1767317512.768548:0:81905:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:1.0:1767317512.768587:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x200000405:0x8f:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1767317512.768603:0:81905:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768660:0:81905:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768668:0:81905:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.768671:0:81905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d03f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a1d expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.768713:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81905 initiator: MDT0 00010000:00010000:1.0:1767317512.768720:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000020:00100000:1.0:1767317512.768732:0:81905:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317512.768738:0:81905:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2a00 x1853164291670272/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317512.768747:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000100:00100000:1.0:1767317512.768783:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670272:192.168.202.133@tcp:101:bash.0 00000100:00100000:1.0:1767317512.769326:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78c00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.772579:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670272:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317512.772613:0:81905:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772650:0:81905:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772659:0:81905:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772672:0:81905:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772685:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772700:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772708:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.772716:0:81905:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317512.772728:0:81905:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317512.772749:0:81905:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.772765:0:81905:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317512.772780:0:81905:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.772792:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.772800:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317512.772859:0:81905:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff8c3c61730908): rc = 0 00000080:00200000:1.0:1767317512.772896:0:81905:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767317512.772902:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d046 00000080:00010000:1.0:1767317512.772915:0:81905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00200008:1.0:1767317512.772933:0:81905:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 101101 00000002:00100000:1.0:1767317512.772962:0:81905:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 776/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317512.773000:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d046 from it ffff8c3c432f83c0 00010000:00010000:1.0:1767317512.773005:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.773013:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.773037:0:81905:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 42 00000002:00010000:1.0:1767317512.773082:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8e:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1767317512.773142:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81905 initiator: MDT0 00010000:00010000:1.0:1767317512.773148:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00010000:00010000:1.0:1767317512.773158:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000100:00100000:1.0:1767317512.773181:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670400:192.168.202.133@tcp:101:bash.0 00000100:00100000:1.0:1767317512.773281:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78c00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.776619:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670400:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317512.776655:0:81905:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.776674:0:81905:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.776688:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317512.776704:0:81905:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff8c3c437c1880 x1853164291670400/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 568/1336 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.776717:0:81905:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.776734:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.776742:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8e:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1767317512.776775:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d04d 00000080:00010000:1.0:1767317512.776784:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d04d from it ffffa7f7c0e3ba48 00010000:00010000:1.0:1767317512.776797:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.776806:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317512.776860:0:81905:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767317512.000000000, mtime 1767317512.000000000, ctime 1767317512.000000000 00010000:00010000:1.0:1767317512.776985:0:81905:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.777012:0:81905:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317512.777069:0:81905:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.777075:0:81905:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.777077:0:81905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d046 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a39 expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317512.777095:0:81905:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317512.777101:0:81905:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291670656/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317512.777123:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670656:192.168.202.133@tcp:36:bash.0 00000100:00100000:1.0:1767317512.777212:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78c00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.781158:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670656:192.168.202.133@tcp:36:bash.0 00000080:00200000:0.0:1767317512.781217:0:81905:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1767317512.781224:0:81905:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00010000:00010000:0.0:1767317512.781249:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:0.0:1767317512.781273:0:81905:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000002:00010000:0.0:1767317512.781287:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317512.781349:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81905 initiator: MDT0 00010000:00010000:0.0:1767317512.781358:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00010000:00010000:0.0:1767317512.781369:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000100:00100000:0.0:1767317512.781393:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670784:192.168.202.133@tcp:101:bash.0 00000100:00100000:0.0:1767317512.781534:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.790030:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291670784:192.168.202.133@tcp:101:bash.0 00010000:00010000:0.0:1767317512.790146:0:81905:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790222:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317512.790241:0:81905:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9df80 x1853164291670784/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317512.790256:0:81905:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317512.790272:0:81905:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790289:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767317512.790313:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317512.790339:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d054 00000080:00010000:0.0:1767317512.790352:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d054 from it ffffa7f7c0e3b8c8 00010000:00010000:0.0:1767317512.790357:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790368:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790412:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790426:0:81905:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317512.790436:0:81905:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317512.790488:0:81905:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 2 00010000:00010000:0.0:1767317512.790495:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790501:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767317512.790518:0:81905:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x8e:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1767317512.790528:0:81905:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 2 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317512.790532:0:81905:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x8e:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1767317512.790542:0:81905:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000002:00010000:0.0:1767317512.790753:0:81905:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 02 00010000:00010000:0.0:1767317512.790775:0:81905:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317512.790793:0:81905:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767317512.790832:0:81905:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790840:0:81905:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317512.790844:0:81905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d054 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a5c expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.790902:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81905 initiator: MDT0 00010000:00010000:0.0:1767317512.790909:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000020:00100000:0.0:1767317512.790923:0:81905:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317512.790932:0:81905:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9df80 x1853164291671040/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317512.790940:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81905 initiator: MDT0 00000100:00100000:0.0:1767317512.790968:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671040:192.168.202.133@tcp:101:bash.0 00000100:00100000:0.0:1767317512.791083:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.802582:0:81905:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937252 gen 1 00000100:00100000:1.0:1767317512.802700:0:81905:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 776/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317512.802719:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671040:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317512.802765:0:81905:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802779:0:81905:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 4/0,1 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802794:0:81905:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802808:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802823:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802832:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802839:0:81905:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317512.802848:0:81905:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9df80 x1853164291671040/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.802907:0:81905:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317512.802922:0:81905:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802949:0:81905:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.802958:0:81905:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317512.802974:0:81905:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d05b 00000080:00010000:1.0:1767317512.802985:0:81905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d05b from it ffffa7f7c0e3b930 00010000:00010000:1.0:1767317512.802988:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.802997:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.803017:0:81905:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767317512.803025:0:81905:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00010000:00010000:1.0:1767317512.803042:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.803054:0:81905:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317512.803074:0:81905:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.803118:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.803126:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.803139:0:81905:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317512.803155:0:81905:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.803159:0:81905:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.803168:0:81905:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317512.803205:0:81905:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317512.803221:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.803229:0:81905:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317512.803237:0:81905:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.803253:0:81905:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317512.803258:0:81905:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.803261:0:81905:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.803263:0:81905:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317512.803272:0:81905:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317512.803348:0:81905:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1767317512.803354:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.803362:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00020000:00200000:1.0:1767317512.803373:0:81905:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8e:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1767317512.803377:0:81905:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.803379:0:81905:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.803384:0:81905:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317512.803413:0:81905:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317512.803429:0:81905:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1767317512.803434:0:81905:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8a30, osc lock ffff8c3c60dd0850, flags 0x80000000 00010000:00010000:1.0:1767317512.803493:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.803502:0:81905:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.803514:0:81905:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317512.803541:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671168:192.168.202.133@tcp:101:bash.0 00000100:00100000:1.0:1767317512.803638:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 11 seconds 00000100:00100000:1.0:1767317512.807146:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671168:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317512.807192:0:81905:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.807211:0:81905:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.807230:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317512.807245:0:81905:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.807259:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.807282:0:81905:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317512.807413:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291671296:192.168.202.133@tcp:10:bash.0 00000100:00100000:1.0:1767317512.818713:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291671296:192.168.202.133@tcp:10:bash.0 00000080:00200000:2.0:1767317512.818798:0:81905:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767317512.818808:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317512.818812:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317512.818819:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8a30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317512.818833:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.818864:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317512.819162:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317512.819166:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8a30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317512.819193:0:81905:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317512.819209:0:81905:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767317512.000000000, mtime 1767317512.000000000, ctime 1767317512.000000000, rc 0 00000080:00200008:2.0:1767317512.819465:0:81905:0:(file.c:2648:do_file_write_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:2.0:1767317512.819484:0:81905:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 14 bytes 00000080:00200000:2.0:1767317512.819490:0:81905:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 14 00000080:00200000:2.0:1767317512.819496:0:81905:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: write ppos: 0, bytes: 14 00000080:00200000:2.0:1767317512.819502:0:81905:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767317512.819512:0:81905:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 1, [0x200000405:0x8e:0x0] hash] 00000020:00200000:2.0:1767317512.819514:0:81905:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 14) 0 0 00000080:00200000:2.0:1767317512.819519:0:81905:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767317512.819536:0:81905:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8e:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:2.0:1767317512.819541:0:81905:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317512.819545:0:81905:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317512.819551:0:81905:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317512.819559:0:81905:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:2.0:1767317512.819642:0:81905:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317512.819664:0:81905:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767317512.819681:0:81905:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767317512.819687:0:81905:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61005b50, flags 0x0 00010000:00010000:2.0:1767317512.819713:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.819741:0:81905:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.819756:0:81905:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.819765:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.819773:0:81905:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317512.819787:0:81905:0:(vvp_io.c:1312:vvp_io_write_start()) f212a.sanity-flr: write [0, 14) append 0 append lockpos 0 00000080:00200000:2.0:1767317512.819799:0:81905:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 14 bytes 00000080:00200000:2.0:1767317512.819849:0:81905:0:(rw26.c:912:ll_write_end()) pos 0, len 14, copied 14 00000080:00200000:2.0:1767317512.819859:0:81905:0:(rw26.c:969:ll_write_end()) page@00000000936dbf5d[3 0000000041c70fe7 2 1 000000009cdb40c7] 00000080:00200000:2.0:1767317512.819862:0:81905:0:(rw26.c:969:ll_write_end()) vmpage @000000006afa314c 17ffffc0001001 3:0 ffff8c3c62823d80 0 lru 00000080:00200000:2.0:1767317512.820050:0:81905:0:(rw26.c:969:ll_write_end()) osc-page@00000000f68e52ec 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000006de10af5 0000000012918e88 > 3< 0 0 > 4< 0 0 8 116707328 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1767317512.820054:0:81905:0:(rw26.c:969:ll_write_end()) end page@00000000936dbf5d 00000080:00200000:2.0:1767317512.820055:0:81905:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:2.0:1767317512.820143:0:81905:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 14 prio 0 00000008:00010000:2.0:1767317512.820168:0:81905:0:(osc_cache.c:814:osc_extent_find()) ### extent: 00000000de2a700c ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317512.820191:0:81905:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff8c3c61730ab8, count 1, dirtied 1 00000080:00200000:2.0:1767317512.820197:0:81905:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 14 bytes, tot: 14 00000080:00200000:2.0:1767317512.820201:0:81905:0:(vvp_io.c:1390:vvp_io_write_start()) f212a.sanity-flr: write bytes 0, result: 14 00000020:00010000:2.0:1767317512.820224:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317512.820227:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317512.820230:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317512.820234:0:81905:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.820243:0:81905:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317512.820258:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317512.820261:0:81905:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317512.820268:0:81905:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000080:00200000:2.0:1767317512.820273:0:81905:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317512.820279:0:81905:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317512.820283:0:81905:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 2 io complete with rc: 0, result: 14, restart: 0 00000080:00200000:2.0:1767317512.820291:0:81905:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000080:00200000:2.0:1767317512.820295:0:81905:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 14 00000080:00200008:2.0:1767317512.820319:0:81905:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 100001 00000002:00100000:2.0:1767317512.820412:0:81905:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 776/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317512.820427:0:81905:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317512.820433:0:81905:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39500 x1853164291671552/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317512.820462:0:81905:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671552:192.168.202.133@tcp:35:bash.0 00000100:00100000:2.0:1767317512.820665:0:81905:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1767317512.823150:0:81905:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:81905:1853164291671552:192.168.202.133@tcp:35:bash.0 00000002:00100000:1.0:1767317512.823199:0:81905:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2a00 x1853164291670272/t8589937249(8589937249) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 776/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317512.852033:0:82050:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317512.852082:0:82050:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.852177:0:82050:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.852199:0:82050:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.852212:0:82050:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82050 initiator: MDT0 00000100:00100000:0.0:1767317512.852246:0:82050:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291671680:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317512.852522:0:82050:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.869726:0:82050:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291671680:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317512.869770:0:82050:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869788:0:82050:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869804:0:82050:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869816:0:82050:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869832:0:82050:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869840:0:82050:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869849:0:82050:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317512.869924:0:82050:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f800 x1853164291671680/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317512.869942:0:82050:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.869958:0:82050:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317512.869967:0:82050:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317512.870170:0:82050:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317512.870179:0:82050:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317512.870187:0:82050:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317512.870190:0:82050:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfbf8 00010000:00010000:0.0:1767317512.870194:0:82050:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.870204:0:82050:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.870237:0:82050:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317512.870265:0:82050:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43b88300, open_flags 18800, mode 0 opened 0 00000080:00200000:0.0:1767317512.870273:0:82050:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:0.0:1767317512.870306:0:82050:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767317512.870370:0:82050:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.870378:0:82050:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82050 initiator: MDT0 00000020:00100000:0.0:1767317512.870412:0:82050:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317512.870420:0:82050:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f800 x1853164291671936/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317512.870430:0:82050:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82050 initiator: MDT0 00000100:00100000:0.0:1767317512.870459:0:82050:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291671936:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317512.870723:0:82050:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.884692:0:82050:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291671936:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317512.884726:0:82050:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884743:0:82050:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884751:0:82050:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884758:0:82050:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884766:0:82050:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884772:0:82050:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317512.884778:0:82050:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884784:0:82050:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884811:0:82050:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884819:0:82050:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317512.884827:0:82050:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82050 initiator: MDT0 00010000:00010000:0.0:1767317512.884835:0:82050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82050 initiator: MDT0 00000002:00100000:0.0:1767317512.884855:0:82050:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c50e9f800 x1853164291671936/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317512.886004:0:82050:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767317512.886177:0:82050:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317512.886205:0:82050:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.886225:0:82050:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.886239:0:82050:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.886244:0:82050:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317512.886250:0:82050:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317512.886253:0:82050:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317512.886259:0:82050:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfbb0 00010000:00010000:0.0:1767317512.886261:0:82050:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.886268:0:82050:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.886289:0:82050:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317512.886297:0:82050:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:0.0:1767317512.886330:0:82050:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=23963d0 00000100:00100000:0.0:1767317512.886422:0:82050:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291672064:192.168.202.133@tcp:34:lfs.0 00000100:00100000:0.0:1767317512.886549:0:82050:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0e40 going to sleep for 12 seconds 00000100:00100000:2.0:1767317512.894261:0:82050:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82050:1853164291672064:192.168.202.133@tcp:34:lfs.0 00000080:00200008:2.0:1767317512.894723:0:82050:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:0.0:1767317512.909689:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317512.909739:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.909764:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.909785:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.909794:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317512.909805:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317512.909810:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317512.909819:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfb58 00010000:00010000:0.0:1767317512.909823:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.909832:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.909851:0:82054:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317512.910041:0:82054:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:0.0:1767317512.910046:0:82054:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317512.910064:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.910137:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:0.0:1767317512.910147:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00010000:00010000:0.0:1767317512.910159:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:0.0:1767317512.910194:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672192:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317512.910383:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0d80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317512.914740:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672192:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317512.914774:0:82054:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914798:0:82054:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914807:0:82054:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914821:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914833:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914849:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914857:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.914909:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317512.914923:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9c000 x1853164291672192/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/824 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317512.914936:0:82054:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317512.914952:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.914964:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767317512.914973:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317512.915039:0:82054:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff8c3c61730908): rc = 0 00000080:00200000:0.0:1767317512.915057:0:82054:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1767317512.915063:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d077 00000080:00010000:0.0:1767317512.915086:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:0.0:1767317512.915091:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d077 from it ffffa7f7c1dbfb20 00010000:00010000:0.0:1767317512.915094:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.915103:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317512.915159:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317512.915168:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:0.0:1767317512.915201:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.915217:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.915230:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317512.915237:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317512.915242:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:0.0:1767317512.915245:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d077 00000080:00010000:0.0:1767317512.915249:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d077 from it ffffa7f7c1dbfcb8 00010000:00010000:0.0:1767317512.915252:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317512.915259:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317512.915279:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317512.915294:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317512.915298:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317512.915303:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767317512.915327:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317512.915332:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287db0, osc lock ffff8c3c50c8fdb0, flags 0x400000400001002 00010000:00010000:0.0:1767317512.915351:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.915362:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317512.915376:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317512.915387:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.915405:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317512.915418:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317512.915431:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000020:00010000:0.0:1767317512.915438:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_release():245 00000020:00010000:0.0:1767317512.915442:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317512.915445:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287db0 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317512.915450:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317512.915453:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287db0 (ffff8c3c547fdc68/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317512.915465:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317512.915542:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317512.915553:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317512.915562:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.915570:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.915577:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317512.915581:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317512.915584:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317512.915589:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfbf8 00010000:00010000:0.0:1767317512.915592:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317512.915611:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317512.915621:0:82054:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317512.915630:0:82054:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:0.0:1767317512.915636:0:82054:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 46 00000080:00200008:0.0:1767317512.915650:0:82054:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154402 00000002:00010000:0.0:1767317512.915670:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1767317512.915740:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:0.0:1767317512.915745:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000020:00100000:0.0:1767317512.915757:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317512.915764:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c000 x1853164291672448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317512.915770:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:0.0:1767317512.915791:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672448:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.916266:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c0d80 going to sleep for 12 seconds 00000100:00100000:2.0:1767317512.919802:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317512.919951:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317512.919980:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379179648 00000100:00100000:3.0:1767317512.920000:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379179648 00000100:00100000:3.0:1767317512.920064:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9454 00000100:00100000:3.0:1767317512.920076:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379179648:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317512.920098:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317512.920232:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317512.920240:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379179648:12345-192.168.202.133@tcp:104: Request processed in 166us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317512.920267:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9454 00010000:00010000:1.0:1767317512.921159:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317512.921171:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921184:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317512.921191:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921198:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921205:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921235:0:63490:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921297:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921302:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.921422:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921430:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d077 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ac5 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.921450:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.921452:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.921455:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317512.921471:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317512.921496:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291672576:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317512.926075:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672448:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317512.926111:0:82054:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926132:0:82054:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926142:0:82054:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926157:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926182:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926200:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926206:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926212:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317512.926220:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317512.926247:0:82054:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317512.926262:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926271:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/142 (0 0) 00000080:00200000:3.0:1767317512.926277:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767317512.926341:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d07e 00000080:00010000:3.0:1767317512.926348:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d07e from it ffffa7f7c1dbfbf0 00010000:00010000:3.0:1767317512.926351:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.926356:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317512.926382:0:82054:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317512.926615:0:82054:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 4 00000080:00200000:3.0:1767317512.926629:0:82054:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000080:00200008:3.0:1767317512.926666:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317512.926675:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:3.0:1767317512.926696:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317512.926705:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:3.0:1767317512.926759:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:3.0:1767317512.926776:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00010000:00010000:3.0:1767317512.926786:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:3.0:1767317512.926809:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672704:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317512.927454:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14a0c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.927747:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291672576:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317512.930785:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317512.930921:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379179776 00000100:00100000:3.0:1767317512.930939:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379179776 00000100:00100000:3.0:1767317512.931013:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9455 00000100:00100000:3.0:1767317512.931026:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379179776:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317512.931054:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.931164:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317512.931182:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379179776:12345-192.168.202.133@tcp:104: Request processed in 149us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317512.931191:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9455 00010000:00010000:1.0:1767317512.931286:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317512.931296:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931305:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cec00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317512.931323:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931333:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931370:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931457:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931466:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.931503:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931512:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d07e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71ad3 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.931534:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.931537:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.931539:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317512.931801:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317512.931824:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291672832:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317512.937428:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291672704:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317512.937469:0:82054:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937488:0:82054:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937506:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937548:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937574:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937584:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317512.937593:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317512.937608:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3480 x1853164291672704/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/824 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317512.937621:0:82054:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317512.937637:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317512.937655:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:3.0:1767317512.937665:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317512.937741:0:82054:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 3 -> 3 00000080:00010000:3.0:1767317512.937747:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d085 00000080:00010000:3.0:1767317512.937753:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:3.0:1767317512.937757:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d085 from it ffffa7f7c1dbfcd8 00010000:00010000:3.0:1767317512.937760:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317512.937776:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317512.937822:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767317512.937837:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317512.937841:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317512.937846:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767317512.937900:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317512.937905:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecfb0, osc lock ffff8c3c60cb4ab0, flags 0x400000400001002 00010000:00010000:3.0:1767317512.937925:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317512.937938:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317512.937950:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317512.937955:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317512.937962:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317512.937973:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317512.937985:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000020:00010000:3.0:1767317512.937993:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317512.937997:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317512.938000:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecfb0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317512.938011:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317512.938014:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecfb0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317512.938026:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1767317512.938109:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=18a02a0 00000002:00010000:3.0:1767317512.938144:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 05004040000002 00000100:00100000:0.0:1767317512.939147:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291672832:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317512.939494:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:1.0:1767317512.939507:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000020:00100000:1.0:1767317512.939521:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317512.939531:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3480 x1853164291673088/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317512.939541:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82054 initiator: MDT0 00000100:00100000:1.0:1767317512.939639:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673088:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.940008:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.944704:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673088:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317512.944742:0:82054:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944756:0:82054:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944771:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944785:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944802:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944811:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.944818:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317512.944830:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317512.944845:0:82054:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.945028:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.945047:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.945134:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767317512.945163:0:82054:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317512.945239:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d08c 00000080:00010000:1.0:1767317512.945248:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d08c from it ffffa7f7c1dbfcc0 00010000:00010000:1.0:1767317512.945252:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.945260:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317512.945436:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317512.945452:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.945456:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.945465:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767317512.945599:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291673216:192.168.202.133@tcp:1:lfs.0 00000100:00100000:2.0:1767317512.948521:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317512.948976:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379179904 00000100:00100000:3.0:1767317512.948990:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379179904 00000100:00100000:2.0:1767317512.949252:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9456 00000100:00100000:2.0:1767317512.949264:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379179904:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317512.949289:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317512.949448:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317512.949456:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379179904:12345-192.168.202.133@tcp:104: Request processed in 195us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317512.949465:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9456 00010000:00010000:1.0:1767317512.949602:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317512.949612:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.949623:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317512.949630:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317512.949676:0:60279:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 00000000de2a700c ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317512.949691:0:60279:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 00000000de2a700c ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.949752:0:60279:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000008:00100000:1.0:1767317512.949838:0:60279:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c3480 - object 0x280000400:160 offset 0<>14 00000100:00100000:0.0:1767317512.951213:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291673344:192.168.202.133@tcp:4:bash.0 00000008:00010000:0.0:1767317512.956265:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 00000000de2a700c ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317512.956443:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 00000000de2a700c ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317512.956483:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291673344:192.168.202.133@tcp:4:bash.0 00000080:00200000:1.0:1767317512.956601:0:60279:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317512.956668:0:60279:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317512.956737:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.956746:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317512.956778:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.956788:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71a71 expref: -99 pid: 81905 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.956818:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.956821:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317512.956823:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317512.956917:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291673472:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317512.960994:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291673472:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317512.961031:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291673216:192.168.202.133@tcp:1:lfs.0 00010000:00010000:1.0:1767317512.961233:0:82054:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.961290:0:82054:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317512.961492:0:82054:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.961506:0:82054:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317512.961560:0:82054:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.961569:0:82054:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.961576:0:82054:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317512.961580:0:82054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d05b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71a6a expref: -99 pid: 81905 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.961601:0:82054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d085 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71ae8 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317512.961620:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317512.961631:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291673728/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317512.961669:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673728:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317512.961789:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.971237:0:82054:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937256 gen 1 00000100:00100000:1.0:1767317512.971261:0:82054:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317512.971271:0:82054:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317512.971299:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673728:192.168.202.133@tcp:36:lfs.0 00010000:00010000:1.0:1767317512.971496:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:1.0:1767317512.971511:0:82054:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000002:00010000:1.0:1767317512.971526:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317512.971591:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:1.0:1767317512.971603:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00010000:00010000:1.0:1767317512.971615:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:1.0:1767317512.971641:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673856:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.971742:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.974949:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673856:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317512.974993:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975012:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317512.975029:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c1c00 x1853164291673856/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.975041:0:82054:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317512.975091:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975108:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.975116:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317512.975143:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d093 00000080:00010000:1.0:1767317512.975155:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d093 from it ffffa7f7c1dbfc70 00010000:00010000:1.0:1767317512.975160:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975180:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975210:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975222:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317512.975230:0:82054:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975278:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975286:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.975329:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317512.975343:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.975347:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.975355:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317512.975401:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317512.975417:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975426:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317512.975434:0:82054:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.975451:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317512.975456:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.975458:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317512.975460:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317512.975469:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317512.975544:0:82054:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1767317512.975550:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.975559:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317512.975588:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=66f4 arg=18a02a0 00000080:00200008:1.0:1767317512.975605:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317512.975620:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317512.975638:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317512.975645:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:1.0:1767317512.975696:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:1.0:1767317512.975704:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00010000:00010000:1.0:1767317512.975715:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:1.0:1767317512.975744:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673984:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317512.976787:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317512.980432:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291673984:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317512.980471:0:82054:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980488:0:82054:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980503:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980517:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980532:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980569:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317512.980578:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317512.980592:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291673984/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/824 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317512.980607:0:82054:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317512.980623:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.980640:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317512.980648:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317512.980727:0:82054:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767317512.980734:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:1.0:1767317512.980743:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317512.980746:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317512.980750:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317512.980759:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317512.980808:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1767317512.980828:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317512.980831:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317512.980837:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317512.980861:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317512.980866:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317512.981084:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.981094:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317512.981106:0:82054:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c437c1c00 x1853164291674112/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767317512.981142:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767317512.981502:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291674112:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317512.985000:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985033:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985050:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985118:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317512.985136:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317512.985167:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317512.985405:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985416:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985424:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317512.985434:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317512.985459:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291674112:192.168.202.133@tcp:101:lfs.0 00000080:00200000:1.0:1767317512.985586:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317512.985596:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317512.985599:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317512.985606:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317512.985612:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317512.985615:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317512.985632:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1767317513.041314:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317513.041345:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317513.041357:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:2.0:1767317513.041391:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.041428:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.041446:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.041456:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.041469:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:2.0:1767317513.041473:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:2.0:1767317513.041483:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:2.0:1767317513.041487:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.041505:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.041545:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1767317513.041561:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317513.041564:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317513.041570:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:2.0:1767317513.041597:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317513.041602:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61005b50, flags 0x400000400001002 00010000:00010000:2.0:1767317513.041624:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.041636:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317513.041651:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317513.041655:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.041663:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317513.041673:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317513.041688:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:2.0:1767317513.041694:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317513.041697:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317513.041701:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317513.041712:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317513.041715:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317513.041730:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317513.041749:0:82054:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1767317513.041754:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1767317513.041759:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317513.041761:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317513.041767:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317513.041787:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:2.0:1767317513.041797:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317513.041803:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1767317513.041805:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317513.041810:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317513.041814:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1767317513.041822:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1767317513.041825:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61005b50, flags 0x0 00010000:00010000:2.0:1767317513.041834:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.041844:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.041853:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.041861:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.042155:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317513.042169:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000100:00100000:3.0:1767317513.042313:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291674240:192.168.202.133@tcp:23:lfs.0 00000100:00100000:3.0:1767317513.044767:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291674240:192.168.202.133@tcp:23:lfs.0 00000020:00010000:1.0:1767317513.044980:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.044984:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.044990:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317513.045000:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.045015:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317513.045058:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.045061:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.045080:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.045091:0:82054:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1767317513.045106:0:82054:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1767317513.045116:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.045125:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.045128:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317513.045134:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317513.045158:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:1.0:1767317513.045162:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.045167:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767317513.045168:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317513.045172:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317513.045175:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767317513.045187:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767317513.045190:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x0 00010000:00010000:1.0:1767317513.045210:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.045222:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.045231:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.045246:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.045251:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317513.045259:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000100:00100000:0.0:1767317513.045368:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291674368:192.168.202.133@tcp:23:lfs.0 00000100:00100000:0.0:1767317513.047644:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291674368:192.168.202.133@tcp:23:lfs.0 00000020:00010000:1.0:1767317513.047759:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.047763:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.047769:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317513.047780:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.047794:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317513.047813:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.047816:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.047838:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.047851:0:82054:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_HOLE, rc = 14 00000080:00200080:1.0:1767317513.047867:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317513.047901:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=1 00000080:00200008:1.0:1767317513.047908:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.047916:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.047941:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.047974:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.047984:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.047990:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.047997:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.048000:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:1.0:1767317513.048006:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.048008:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.048013:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.048032:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.048042:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.048044:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.048047:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.048071:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.048074:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.048086:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.048092:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.048103:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.048110:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.048115:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.048123:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.048132:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.048134:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.048136:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048138:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048140:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.048141:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.048145:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.048168:0:82054:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767317513.048171:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.048173:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.048175:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317513.048178:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.048182:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767317513.048184:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.048186:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.048187:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.048191:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.048192:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.048197:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.048209:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.048215:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.048217:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.048223:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.048228:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.048231:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.048232:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.048233:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048235:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048236:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.048238:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.048242:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.048246:0:82054:0:(file.c:2367:file_read_confine_iter()) f212a.sanity-flr: read [0, 4096] over eof, kms 14, file_size 14. 00000080:00200000:1.0:1767317513.048255:0:82054:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:1.0:1767317513.048264:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000020:00200000:1.0:1767317513.048270:0:82054:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:1.0:1767317513.048273:0:82054:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:1.0:1767317513.048274:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00000080:00200000:1.0:1767317513.048281:0:82054:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317513.048288:0:82054:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:1.0:1767317513.048291:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317513.048307:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767317513.048313:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317513.048316:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x40000 00000080:00200000:1.0:1767317513.048320:0:82054:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000080:00200000:1.0:1767317513.048331:0:82054:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:1.0:1767317513.048337:0:82054:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:1.0:1767317513.048392:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317513.048404:0:82054:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:1.0:1767317513.048410:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.048413:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048415:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.048418:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.048420:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.048425:0:82054:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:1.0:1767317513.048429:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317513.048452:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319600 00000008:00100000:1.0:1767317513.048506:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c1180 - object 0x280000400:160 offset 0<>14 00000100:00100000:0.0:1767317513.048587:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291674496:192.168.202.133@tcp:3:lfs.0 00000008:00010000:0.0:1767317513.051607:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319600 00000020:00200000:0.0:1767317513.051623:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317513.051634:0:2518:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:0.0:1767317513.051645:0:2518:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767317513.051661:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317513.051737:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319600 00000100:00100000:0.0:1767317513.051790:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291674496:192.168.202.133@tcp:3:lfs.0 00000080:00200000:1.0:1767317513.051952:0:82054:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317513.051969:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.051974:0:82054:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:1.0:1767317513.051978:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.051988:0:82054:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:1.0:1767317513.052010:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317513.052022:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=2 00000080:00200008:1.0:1767317513.052030:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.052038:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.052114:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.052134:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.052157:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.052163:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.052216:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.052220:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:1.0:1767317513.052228:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.052231:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.052238:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.052260:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.052271:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.052273:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.052276:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.052293:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.052296:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.052313:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.052319:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.052327:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.052330:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.052339:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.052347:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.052356:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.052359:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.052362:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.052365:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.052370:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.052373:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.052382:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.052420:0:82054:0:(file.c:2648:do_file_write_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767317513.052428:0:82054:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767317513.052437:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:1.0:1767317513.052447:0:82054:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:1.0:1767317513.052449:0:82054:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:1.0:1767317513.052452:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00000080:00200000:1.0:1767317513.052464:0:82054:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317513.052472:0:82054:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767317513.052477:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767317513.052493:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767317513.052502:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317513.052505:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x40000 00000080:00200000:1.0:1767317513.052514:0:82054:0:(vvp_io.c:1312:vvp_io_write_start()) f212a.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767317513.052552:0:82054:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767317513.052616:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317513.052619:0:82054:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1767317513.052631:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.052640:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.052643:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.052647:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.052650:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.052652:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.052659:0:82054:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767317513.052665:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317513.052689:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319480 00000008:00100000:1.0:1767317513.052785:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c1180 - object 0x2c0000400:192 offset 0<>4096 00000100:00100000:0.0:1767317513.052861:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291674624:192.168.202.133@tcp:4:lfs.0 00010000:00010000:1.0:1767317513.057029:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317513.059765:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805046 gen 3 00000008:00010000:0.0:1767317513.059898:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319480 00000020:00200000:0.0:1767317513.059905:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317513.059915:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317513.059926:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319480 00000100:00100000:0.0:1767317513.059951:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291674624:192.168.202.133@tcp:4:lfs.0 00000080:00200000:1.0:1767317513.060050:0:82054:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317513.060074:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.060079:0:82054:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767317513.060091:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00200000:1.0:1767317513.060094:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.060103:0:82054:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1767317513.060128:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317513.060137:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=1 00000080:00200008:1.0:1767317513.060145:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.060153:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.060178:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.060202:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.060219:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.060228:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.060236:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.060258:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:1.0:1767317513.060268:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.060272:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.060279:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.060303:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.060314:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.060316:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.060321:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.060339:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.060341:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.060357:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060365:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.060374:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.060376:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060382:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.060388:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.060429:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.060433:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.060437:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.060440:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.060445:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.060449:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.060457:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.060469:0:82054:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 14, type: SEEK_DATA 00000080:00200000:1.0:1767317513.060474:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.060479:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.060481:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317513.060487:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317513.060506:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:1.0:1767317513.060516:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.060521:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767317513.060524:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317513.060529:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317513.060533:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767317513.060540:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767317513.060542:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x0 00010000:00010000:1.0:1767317513.060552:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060563:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060573:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060592:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060599:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317513.060611:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.060616:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.060619:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.060622:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317513.060626:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060633:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317513.060643:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.060645:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.060653:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.060660:0:82054:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1767317513.060664:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.060668:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.060671:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.060673:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.060679:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.060687:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.060695:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060705:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.060713:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.060715:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.060723:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.060731:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.060736:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.060738:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.060741:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.060744:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.060746:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.060749:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.060754:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.060762:0:82054:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: (null), rc = 14 00000080:00200080:1.0:1767317513.060769:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317513.072379:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=2 00000080:00200008:1.0:1767317513.072421:0:82054:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.072435:0:82054:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.072489:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.072514:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.072533:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.072542:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.072553:0:82054:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.072558:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d09a 00000080:00010000:1.0:1767317513.072568:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d09a from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.072573:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.072583:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.072624:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.072639:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.072643:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317513.072648:0:82054:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.072676:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.072680:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x400000400001002 00010000:00010000:1.0:1767317513.072703:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.072715:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.072742:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317513.072747:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.072756:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317513.072770:0:82054:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.072867:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767317513.072973:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.072977:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.072981:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.072986:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.072989:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.073005:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317513.073049:0:82054:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 14, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 14, atime 1767317513.000000000, mtime 1767317513.000000000, ctime 1767317513.000000000 00010000:00010000:1.0:1767317513.073153:0:82054:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.073176:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.073248:0:82054:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.073257:0:82054:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317513.073270:0:82054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d09a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71b20 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317513.073308:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317513.073330:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291674880/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317513.073366:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291674880:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317513.073603:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.077215:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291674880:192.168.202.133@tcp:36:lfs.0 00000080:00200000:1.0:1767317513.077288:0:82054:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1767317513.077298:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.077333:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767317513.077356:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317513.077380:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317513.077386:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1560, flags 0x0 00010000:00010000:1.0:1767317513.077491:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.077504:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.077519:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317513.077551:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675008:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317513.077664:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 11 seconds 00000100:00100000:1.0:1767317513.080814:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675008:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.080913:0:82054:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.080959:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.080979:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317513.080996:0:82054:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.081010:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.081020:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317513.081167:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291675136:192.168.202.133@tcp:10:lfs.0 00000100:00100000:1.0:1767317513.085370:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291675136:192.168.202.133@tcp:10:lfs.0 00000080:00200000:2.0:1767317513.085514:0:82054:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:2.0:1767317513.085527:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317513.085532:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317513.085538:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317513.085553:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.085568:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317513.085590:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317513.085593:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317513.085617:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317513.085633:0:82054:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 14, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 14, atime 1767317513.000000000, mtime 1767317513.000000000, ctime 1767317513.000000000, rc 0 00000080:00200080:2.0:1767317513.085659:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200008:2.0:1767317513.085699:0:82054:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 14, valid attrs 101f0, mode a7f7, uid 1218298936, gid -29636, new size 18446616789693696264, atime 1767317512.000000000, mtime 1767317512.000000000, ctime 1767317513.000000000 00000020:00100000:2.0:1767317513.085793:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317513.085805:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38700 x1853164291675392/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317513.085868:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675392:192.168.202.133@tcp:36:lfs.0 00000100:00100000:2.0:1767317513.086014:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf240 going to sleep for 12 seconds 00000100:00100000:2.0:1767317513.089354:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675392:192.168.202.133@tcp:36:lfs.0 00000080:00200000:2.0:1767317513.089443:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1767317513.089463:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317513.089468:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317513.089479:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317513.089503:0:82054:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1767317513.089528:0:82054:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767317513.089535:0:82054:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c61004720, flags 0x0 00010000:00010000:2.0:1767317513.089563:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c5075ac00 type 11 mode 2 res 10737419264/160 (0 18446744073709551615) 00010000:00010000:2.0:1767317513.089627:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.089639:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.089652:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767317513.089677:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675520:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.089780:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1767317513.093356:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.093424:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379180288 00000100:00100000:3.0:1767317513.093441:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379180288 00000100:00100000:3.0:1767317513.093514:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9457 00000100:00100000:3.0:1767317513.093528:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379180288:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.093555:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.093661:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317513.093670:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379180288:12345-192.168.202.133@tcp:104: Request processed in 145us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.093678:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9457 00010000:00010000:1.0:1767317513.097651:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317513.097676:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.097695:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1c00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317513.097705:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317513.097771:0:42099:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317513.097788:0:42099:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317513.097886:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.097895:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317513.097932:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.097941:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b27 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.097963:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.097965:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.097967:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317513.097978:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317513.098007:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291675648:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.101810:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.101865:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379180416 00000100:00100000:3.0:1767317513.101930:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379180416 00000100:00100000:3.0:1767317513.101998:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9458 00000100:00100000:3.0:1767317513.102010:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379180416:12345-192.168.202.133@tcp:105: 00010000:00010000:3.0:1767317513.102053:0:42090:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102077:0:42090:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102088:0:42090:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102103:0:42090:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102115:0:42090:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102129:0:42090:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.102153:0:42090:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c3c629d1600) 00000100:00100000:3.0:1767317513.102230:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379180416:12345-192.168.202.133@tcp:105: Request processed in 222us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.102239:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9458 00000100:00100000:2.0:1767317513.106829:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291675520:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317513.106924:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.106973:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317513.106990:0:82054:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.107005:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317513.107014:0:82054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767317513.107140:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291675776:192.168.202.133@tcp:2:lfs.0 00000100:00100000:2.0:1767317513.112838:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291675776:192.168.202.133@tcp:2:lfs.0 00000020:00010000:3.0:1767317513.113461:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317513.113469:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.113477:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317513.113491:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.113532:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317513.113556:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317513.113560:0:82054:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317513.113590:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317513.113610:0:82054:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908) current size 14, valid attrs 101f0, mode a7f7, uid 1218298936, gid -29636, new size 18446616789693696264, atime 1767317512.000000000, mtime 1767317512.000000000, ctime 1767317513.000000000, rc 0 00000080:00200080:3.0:1767317513.113643:0:82054:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=18a02a0 00010000:00010000:3.0:1767317513.113722:0:82054:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.113742:0:82054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d08c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71af6 expref: -99 pid: 82054 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317513.113768:0:82054:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317513.113795:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317513.113802:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc2300 x1853164291676032/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317513.113832:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676032:192.168.202.133@tcp:35:lfs.0 00000100:00100000:3.0:1767317513.114609:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317513.114843:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291675648:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.118190:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317513.118314:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379180544 00000100:00100000:2.0:1767317513.118328:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379180544 00000100:00100000:2.0:1767317513.118409:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9459 00000100:00100000:2.0:1767317513.118422:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379180544:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317513.118448:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.118551:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317513.118558:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379180544:12345-192.168.202.133@tcp:104: Request processed in 140us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317513.118596:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9459 00010000:00010000:0.0:1767317513.119207:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317513.119218:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119230:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317513.119236:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119247:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119257:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317513.119301:0:50308:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767317513.119360:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119368:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317513.119403:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119421:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d093 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b12 expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.119441:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.119443:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.119445:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317513.119455:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317513.119478:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291676160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317513.125347:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291676160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317513.130965:0:82054:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937260 gen 1 00000100:00100000:2.0:1767317513.131016:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676032:192.168.202.133@tcp:35:lfs.0 00000002:00100000:2.0:1767317513.131072:0:82054:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc3480 x1853164291673088/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767317513.131119:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:2.0:1767317513.131135:0:82054:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000002:00010000:2.0:1767317513.131152:0:82054:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:2.0:1767317513.131232:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82054 initiator: MDT0 00010000:00010000:2.0:1767317513.131241:0:82054:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00010000:00010000:2.0:1767317513.131254:0:82054:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82054 initiator: MDT0 00000100:00100000:2.0:1767317513.131281:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676288:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.131379:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317513.134401:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676288:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317513.134439:0:82054:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134458:0:82054:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767317513.134476:0:82054:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c46a38700 x1853164291676288/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/584 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317513.134522:0:82054:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767317513.134538:0:82054:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134555:0:82054:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:2.0:1767317513.134563:0:82054:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317513.134588:0:82054:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0b6 00000080:00010000:2.0:1767317513.134601:0:82054:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0b6 from it ffffa7f7c1dbfbc8 00010000:00010000:2.0:1767317513.134605:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134615:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134647:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134662:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317513.134670:0:82054:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134724:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.134732:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.134757:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 1 restore needed 0 00020000:00200000:2.0:1767317513.134771:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317513.134774:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317513.135357:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317513.135405:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1767317513.135429:0:82054:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.135441:0:82054:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317513.135450:0:82054:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](00000000121202c1) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.135477:0:82054:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317513.135483:0:82054:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317513.135486:0:82054:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317513.135488:0:82054:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317513.135497:0:82054:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1767317513.135513:0:82054:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 14 blocks 8 [cma]time: 1767317512 1767317512 0 by oinfo size 14 blocks 8 [cma]time 1767317513 1767317512 1767317512 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317513.135547:0:82054:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317513 1767317513 0 by oinfo size 14 blocks 8 [cma]time 1767317513 1767317513 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317513.135608:0:82054:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:2.0:1767317513.135622:0:82054:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.135631:0:82054:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317513.135670:0:82054:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154002 00000002:00100000:2.0:1767317513.135731:0:82054:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317513.135745:0:82054:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317513.135751:0:82054:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38700 x1853164291676544/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317513.136917:0:82054:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676544:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317513.137046:0:82054:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767317513.140707:0:82054:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82054:1853164291676544:192.168.202.133@tcp:35:lfs.0 00000002:00100000:2.0:1767317513.140759:0:82054:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9c000 x1853164291672448/t8589937254(8589937254) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317529 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317513.177364:0:82056:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317513.177419:0:82056:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.177445:0:82056:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.177464:0:82056:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.177472:0:82056:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.177482:0:82056:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317513.177494:0:82056:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:2.0:1767317513.177505:0:82056:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0d4bbf8 00010000:00010000:2.0:1767317513.177509:0:82056:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.177518:0:82056:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.177540:0:82056:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317513.177557:0:82056:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c629fa300, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1767317513.177565:0:82056:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:2.0:1767317513.177588:0:82056:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:2.0:1767317513.177666:0:82056:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.177674:0:82056:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82056 initiator: MDT0 00000020:00100000:2.0:1767317513.177689:0:82056:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317513.177706:0:82056:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38700 x1853164291676800/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317513.177717:0:82056:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82056 initiator: MDT0 00000100:00100000:2.0:1767317513.177747:0:82056:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82056:1853164291676800:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.178432:0:82056:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317513.184723:0:82056:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82056:1853164291676800:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317513.184754:0:82056:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.184865:0:82056:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185299:0:82056:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185308:0:82056:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185316:0:82056:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185323:0:82056:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:2.0:1767317513.185329:0:82056:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185337:0:82056:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185346:0:82056:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185354:0:82056:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767317513.185363:0:82056:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82056 initiator: MDT0 00010000:00010000:2.0:1767317513.185370:0:82056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82056 initiator: MDT0 00000002:00100000:2.0:1767317513.185403:0:82056:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c46a38700 x1853164291676800/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317513.185421:0:82056:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767317513.186690:0:82056:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317513.186728:0:82056:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317513.186752:0:82056:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.186768:0:82056:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317513.186840:0:82056:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317513.186851:0:82056:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317513.186855:0:82056:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317513.186863:0:82056:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0d4bbb0 00010000:00010000:0.0:1767317513.187241:0:82056:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.187255:0:82056:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317513.187295:0:82056:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317513.187310:0:82056:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:0.0:1767317513.187359:0:82056:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=d6c3d0 00000100:00100000:0.0:1767317513.187460:0:82056:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82056:1853164291676928:192.168.202.133@tcp:34:lfs.0 00000100:00100000:0.0:1767317513.187627:0:82056:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c00c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317513.190772:0:82056:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82056:1853164291676928:192.168.202.133@tcp:34:lfs.0 00000080:00200008:0.0:1767317513.191179:0:82056:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:3.0:1767317513.212836:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317513.213013:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317513.213035:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.213051:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317513.213117:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317513.213125:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317513.213129:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:3.0:1767317513.213136:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dafb58 00010000:00010000:3.0:1767317513.213139:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.213148:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317513.213168:0:82058:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317513.213186:0:82058:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:3.0:1767317513.213191:0:82058:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317513.213209:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317513.213272:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82058 initiator: MDT0 00010000:00010000:3.0:1767317513.213278:0:82058:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82058 initiator: MDT0 00010000:00010000:3.0:1767317513.213286:0:82058:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82058 initiator: MDT0 00000100:00100000:3.0:1767317513.213321:0:82058:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677056:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317513.213534:0:82058:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14a180 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.216540:0:82058:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677056:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.216573:0:82058:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216595:0:82058:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216628:0:82058:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216642:0:82058:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216655:0:82058:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216669:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216678:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.216686:0:82058:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.216696:0:82058:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1f80 x1853164291677056/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/824 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317513.216706:0:82058:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317513.216718:0:82058:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.216727:0:82058:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317513.216733:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317513.216794:0:82058:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767317513.216798:0:82058:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff8c3c61730908): rc = 0 00000080:00200000:1.0:1767317513.216814:0:82058:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767317513.216820:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:1.0:1767317513.216835:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.216839:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1dafb20 00010000:00010000:1.0:1767317513.216843:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.216852:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317513.217060:0:82058:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.217071:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.217099:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.217106:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.217115:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.217120:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.217125:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.217127:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:1.0:1767317513.217130:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1dafcb8 00010000:00010000:1.0:1767317513.217132:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.217136:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.217341:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317513.217352:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.217360:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.217369:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.217375:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.217379:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317513.217382:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:1.0:1767317513.217386:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dafbf8 00010000:00010000:1.0:1767317513.217389:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.217406:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.217416:0:82058:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317513.217423:0:82058:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:1.0:1767317513.217429:0:82058:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 44 00000080:00200008:1.0:1767317513.217439:0:82058:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154400 00000002:00010000:1.0:1767317513.217456:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1767317513.217516:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82058 initiator: MDT0 00010000:00010000:1.0:1767317513.217525:0:82058:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82058 initiator: MDT0 00000020:00100000:1.0:1767317513.217550:0:82058:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317513.217560:0:82058:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291677312/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317513.217569:0:82058:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82058 initiator: MDT0 00000100:00100000:1.0:1767317513.217597:0:82058:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677312:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317513.217838:0:82058:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.221311:0:82058:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677312:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.221355:0:82058:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.221367:0:82058:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.221382:0:82058:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.221407:0:82058:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.221425:0:82058:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c2300 x1853164291677312/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317513.221438:0:82058:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291677312/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317513.221453:0:82058:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317513.221488:0:82058:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.221501:0:82058:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317513.221509:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317513.221573:0:82058:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767317513.221590:0:82058:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767317513.221595:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0cb 00000080:00010000:1.0:1767317513.221604:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0cb from it ffffa7f7c1dafbf0 00010000:00010000:1.0:1767317513.221609:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.221620:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317513.221653:0:82058:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291677312/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767317513.221805:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=7ffcffb89094 00000002:00010000:1.0:1767317513.221832:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767317513.223299:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82058 initiator: MDT0 00010000:00010000:1.0:1767317513.223313:0:82058:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82058 initiator: MDT0 00000020:00100000:1.0:1767317513.223329:0:82058:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317513.223341:0:82058:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291677568/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317513.223366:0:82058:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82058 initiator: MDT0 00000100:00100000:1.0:1767317513.223406:0:82058:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677568:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317513.223650:0:82058:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.227403:0:82058:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291677568:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.227443:0:82058:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227458:0:82058:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227474:0:82058:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227487:0:82058:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227502:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227510:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227518:0:82058:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.227531:0:82058:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c1f80 x1853164291677568/t8589937263(8589937263) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317513.227568:0:82058:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291677568/t8589937263(8589937263) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317513.227587:0:82058:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227605:0:82058:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317513.227613:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767317513.227638:0:82058:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291677568/t8589937263(8589937263) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317513.227648:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0d2 00000080:00010000:1.0:1767317513.227656:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0d2 from it ffffa7f7c1dafcc0 00010000:00010000:1.0:1767317513.227660:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.227667:0:82058:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.228159:0:82058:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317513.228279:0:82058:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000080:00200008:1.0:1767317513.228323:0:82058:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.228335:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.228366:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.228379:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.228652:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.228670:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.228679:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.228683:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:1.0:1767317513.228690:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1dafcd8 00010000:00010000:1.0:1767317513.228694:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.228702:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317513.228787:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=66f4 arg=1 00000080:00200080:3.0:1767317513.294549:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317513.294580:0:82058:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317513.294592:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:3.0:1767317513.294636:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317513.294660:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.294680:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317513.294690:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317513.294703:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:3.0:1767317513.294707:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:3.0:1767317513.294716:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1dafcd8 00010000:00010000:3.0:1767317513.294720:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.294729:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317513.294772:0:82058:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:3.0:1767317513.294787:0:82058:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767317513.294803:0:82058:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317513.294806:0:82058:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317513.294825:0:82058:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317513.294836:0:82058:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:3.0:1767317513.294858:0:82058:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317513.294868:0:82058:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:3.0:1767317513.295128:0:82058:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:3.0:1767317513.295133:0:82058:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1767317513.295144:0:82058:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317513.295154:0:82058:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:3.0:1767317513.295159:0:82058:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317513.295184:0:82058:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317513.295207:0:82058:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317513.295212:0:82058:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb4ab0, flags 0x40000 00000080:00200000:3.0:1767317513.295222:0:82058:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:3.0:1767317513.295229:0:82058:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767317513.295234:0:82058:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317513.295236:0:82058:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecb30, osc lock ffff8c3c60cb4be0, flags 0x400001002 00010000:00010000:3.0:1767317513.295253:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.295266:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317513.295282:0:82058:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317513.295294:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317513.295298:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.295306:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317513.295318:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317513.295422:0:82058:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767317513.295428:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317513.295431:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.295435:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecb30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.295440:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317513.295444:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecb30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317513.295460:0:82058:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:3.0:1767317513.295469:0:82058:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317513.295540:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317513.295543:0:82058:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:3.0:1767317513.295552:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317513.295555:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.295557:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.295560:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317513.295563:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317513.295569:0:82058:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:3.0:1767317513.295575:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317513.295608:0:76384:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bac00 00000008:00100000:3.0:1767317513.295669:0:76384:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc2d80 - object 0x280000400:160 offset 0<>14 00000100:00100000:2.0:1767317513.295763:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291677696:192.168.202.133@tcp:3:lfs.0 00000100:00100000:3.0:1767317513.298629:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.298680:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379180928 00000100:00100000:3.0:1767317513.298692:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379180928 00000100:00100000:3.0:1767317513.298755:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9460 00000100:00100000:3.0:1767317513.298766:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379180928:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.298787:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.299571:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317513.299603:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36299:x1853164379180928:12345-192.168.202.133@tcp:104: Request processed in 836us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.299613:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9460 00010000:00010000:1.0:1767317513.300580:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317513.300596:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.300612:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317513.300621:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400020000 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317513.300658:0:42098:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317513.300676:0:42098:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317513.300748:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.300757:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317513.300840:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291677824:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317513.301120:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.301149:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d0af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71b51 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.301183:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.301186:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.301188:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000008:00010000:2.0:1767317513.306576:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bac00 00000020:00200000:2.0:1767317513.306592:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317513.306602:0:2520:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:2.0:1767317513.306613:0:2520:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317513.306629:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317513.306644:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bac00 00000100:00100000:2.0:1767317513.306673:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291677696:192.168.202.133@tcp:3:lfs.0 00000080:00200000:3.0:1767317513.306840:0:82058:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317513.306857:0:82058:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317513.306863:0:82058:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:3.0:1767317513.306866:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317513.307024:0:82058:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:3.0:1767317513.307064:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317513.307115:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=2 00000080:00200008:3.0:1767317513.307125:0:82058:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317513.307135:0:82058:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:3.0:1767317513.307318:0:82058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317513.307418:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.307436:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317513.307446:0:82058:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317513.307455:0:82058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:3.0:1767317513.307460:0:82058:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:3.0:1767317513.307470:0:82058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1dafcd8 00010000:00010000:3.0:1767317513.307474:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.307484:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317513.307550:0:82058:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:3.0:1767317513.307560:0:82058:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1767317513.307574:0:82058:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317513.307577:0:82058:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317513.307592:0:82058:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317513.307600:0:82058:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:3.0:1767317513.307613:0:82058:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767317513.307623:0:82058:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:3.0:1767317513.307626:0:82058:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:3.0:1767317513.307628:0:82058:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1767317513.307639:0:82058:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317513.307649:0:82058:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:3.0:1767317513.307654:0:82058:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:3.0:1767317513.307675:0:82058:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317513.307694:0:82058:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317513.307698:0:82058:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb4ab0, flags 0x40000 00000080:00200000:3.0:1767317513.307707:0:82058:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:3.0:1767317513.307715:0:82058:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767317513.307720:0:82058:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317513.307722:0:82058:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecb30, osc lock ffff8c3c60cb4be0, flags 0x400001002 00010000:00010000:3.0:1767317513.307737:0:82058:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.307748:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317513.307762:0:82058:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317513.307784:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317513.307789:0:82058:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.307796:0:82058:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317513.307809:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317513.307817:0:82058:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 16 00000020:00010000:3.0:1767317513.307821:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317513.307825:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.307828:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecb30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.307833:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317513.307835:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecb30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317513.307848:0:82058:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:3.0:1767317513.307856:0:82058:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317513.308431:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317513.308435:0:82058:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:3.0:1767317513.308445:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317513.308448:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.308451:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317513.308454:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317513.308456:0:82058:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317513.308462:0:82058:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:3.0:1767317513.308469:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317513.308500:0:76384:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bae40 00000008:00100000:3.0:1767317513.308571:0:76384:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc2d80 - object 0x2c0000400:192 offset 0<>14 00000100:00100000:2.0:1767317513.308651:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291677952:192.168.202.133@tcp:3:lfs.0 00000100:00100000:0.0:1767317513.311126:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291677824:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317513.318283:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.318463:0:42091:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317513.318486:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379181056 00000100:00100000:3.0:1767317513.318498:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379181056 00000100:00100000:3.0:1767317513.318597:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9461 00000100:00100000:3.0:1767317513.318610:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36299:x1853164379181056:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.318633:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317513.318723:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317513.318730:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36299:x1853164379181056:12345-192.168.202.133@tcp:104: Request processed in 124us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.318739:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9461 00010000:00010000:0.0:1767317513.318821:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317513.318830:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.318840:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317513.318846:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317513.318915:0:63742:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00000080:00200000:0.0:1767317513.318931:0:63742:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767317513.318987:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.318995:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317513.319042:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.319051:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d0a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71b43 expref: -99 pid: 82054 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.319085:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.319087:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.319089:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317513.319098:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317513.319115:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291678080:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317513.328343:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291678080:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:2.0:1767317513.328752:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bae40 00000020:00200000:2.0:1767317513.328761:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317513.328770:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:2.0:1767317513.328782:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317513.328800:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317513.328821:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bae40 00000100:00100000:2.0:1767317513.328848:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291677952:192.168.202.133@tcp:3:lfs.0 00000080:00200000:3.0:1767317513.329086:0:82058:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317513.329103:0:82058:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317513.329109:0:82058:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:3.0:1767317513.329113:0:82058:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317513.329122:0:82058:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:3.0:1767317513.329145:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317513.343678:0:82058:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=7ffcffb890a4 00010000:00010000:2.0:1767317513.343717:0:82058:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.343790:0:82058:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.343798:0:82058:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1767317513.343829:0:82058:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291678208:192.168.202.133@tcp:103:lfs.0 00000100:00100000:2.0:1767317513.344345:0:82058:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767317513.347543:0:82058:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291678208:192.168.202.133@tcp:103:lfs.0 00010000:00010000:3.0:1767317513.347580:0:82058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d0d2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71bc8 expref: -99 pid: 82058 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317513.347666:0:82058:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291677568/t8589937263(8589937263) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317513.347680:0:82058:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317513.347686:0:82058:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc2680 x1853164291678464/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317513.347730:0:82058:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291678464:192.168.202.133@tcp:35:lfs.0 00000100:00100000:3.0:1767317513.347820:0:82058:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14a900 going to sleep for 11 seconds 00000100:00100000:3.0:1767317513.351091:0:82058:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82058:1853164291678464:192.168.202.133@tcp:35:lfs.0 00000002:00100000:3.0:1767317513.351137:0:82058:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291677568/t8589937263(8589937263) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767317513.351203:0:82058:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154000 00010000:00010000:3.0:1767317513.351237:0:82058:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.367700:0:82059:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317513.367738:0:82059:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.367760:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.367778:0:82059:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.367787:0:82059:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.367796:0:82059:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317513.367801:0:82059:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:2.0:1767317513.367809:0:82059:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1483bf8 00010000:00010000:2.0:1767317513.367813:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.367822:0:82059:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.367839:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317513.367847:0:82059:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:2.0:1767317513.367852:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 44 00000080:00200008:2.0:1767317513.367860:0:82059:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154400 00000080:00200000:2.0:1767317513.368273:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 4 00000080:00200000:2.0:1767317513.368282:0:82059:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000080:00200008:2.0:1767317513.368318:0:82059:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317513.368324:0:82059:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:2.0:1767317513.368422:0:82059:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.368434:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.368454:0:82059:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.368462:0:82059:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.368467:0:82059:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:2.0:1767317513.368470:0:82059:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0c4 00000080:00010000:2.0:1767317513.368474:0:82059:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0c4 from it ffffa7f7c1483cd8 00010000:00010000:2.0:1767317513.368477:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.368485:0:82059:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317513.368525:0:82059:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154000 00010000:00010000:2.0:1767317513.368536:0:82059:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317513.368571:0:82059:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317513.368578:0:82059:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.368584:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.368591:0:82059:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.368598:0:82059:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.368601:0:82059:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317513.368603:0:82059:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:2.0:1767317513.368611:0:82059:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1483bf8 00010000:00010000:2.0:1767317513.368614:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.368622:0:82059:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.368630:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317513.368634:0:82059:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:2.0:1767317513.368637:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 46 00000080:00200008:2.0:1767317513.368641:0:82059:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 100002 00000002:00010000:2.0:1767317513.368652:0:82059:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100003 00010000:00010000:2.0:1767317513.368715:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82059 initiator: MDT0 00010000:00010000:2.0:1767317513.368722:0:82059:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82059 initiator: MDT0 00000020:00100000:2.0:1767317513.368735:0:82059:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317513.368750:0:82059:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38a80 x1853164291678720/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317513.368759:0:82059:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82059 initiator: MDT0 00000100:00100000:2.0:1767317513.368784:0:82059:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291678720:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.369322:0:82059:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bff00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317513.374471:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.374733:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379183104 00000100:00100000:3.0:1767317513.374745:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379183104 00000100:00100000:3.0:1767317513.374838:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9462 00000100:00100000:3.0:1767317513.374849:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379183104:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.374917:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.375007:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317513.375014:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379183104:12345-192.168.202.133@tcp:104: Request processed in 167us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.375023:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9462 00010000:00010000:1.0:1767317513.375262:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317513.375271:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375282:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317513.375288:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375299:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375308:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375349:0:63276:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375411:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375419:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317513.375452:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375473:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d0c4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ba5 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.375489:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.375490:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.375492:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317513.375503:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317513.375522:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291678848:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.382500:0:82059:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291678720:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317513.382536:0:82059:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382558:0:82059:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382587:0:82059:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382601:0:82059:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382615:0:82059:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382630:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382637:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382644:0:82059:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317513.382657:0:82059:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c46a38a80 x1853164291678720/t8589937265(8589937265) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317513.382671:0:82059:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38a80 x1853164291678720/t8589937265(8589937265) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317513.382688:0:82059:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382699:0:82059:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/142 (0 0) 00000080:00200000:3.0:1767317513.382707:0:82059:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317513.382771:0:82059:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00010000:3.0:1767317513.382777:0:82059:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0d9 00000080:00010000:3.0:1767317513.382785:0:82059:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0d9 from it ffffa7f7c1483bf0 00010000:00010000:3.0:1767317513.382789:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.382798:0:82059:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317513.382830:0:82059:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38a80 x1853164291678720/t8589937265(8589937265) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317513.383039:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 4 00000080:00200000:3.0:1767317513.383049:0:82059:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000080:00200008:3.0:1767317513.383424:0:82059:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317513.383435:0:82059:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:3.0:1767317513.383454:0:82059:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317513.383466:0:82059:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:3.0:1767317513.383519:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82059 initiator: MDT0 00010000:00010000:3.0:1767317513.383527:0:82059:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82059 initiator: MDT0 00010000:00010000:3.0:1767317513.383536:0:82059:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82059 initiator: MDT0 00000100:00100000:3.0:1767317513.383563:0:82059:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291678976:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317513.383663:0:82059:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a14ac00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317513.386796:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:1.0:1767317513.387225:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291678848:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.387326:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379183232 00000100:00100000:3.0:1767317513.387447:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379183232 00000100:00100000:2.0:1767317513.387641:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9463 00000100:00100000:2.0:1767317513.387661:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379183232:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317513.387694:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.387790:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317513.387798:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379183232:12345-192.168.202.133@tcp:104: Request processed in 140us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317513.387805:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9463 00010000:00010000:1.0:1767317513.387916:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317513.387924:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.387933:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317513.387939:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.387947:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.387955:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.387990:0:63490:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.388034:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.388048:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317513.388084:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.388092:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d0d9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71beb expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.388108:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.388111:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.388113:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317513.388131:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291679104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.393790:0:82059:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291678976:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317513.393824:0:82059:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393839:0:82059:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393854:0:82059:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393864:0:82059:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393899:0:82059:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393905:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317513.393911:0:82059:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317513.393919:0:82059:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc2680 x1853164291678976/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/824 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317513.393928:0:82059:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317513.393940:0:82059:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.393971:0:82059:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:3.0:1767317513.393978:0:82059:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317513.394028:0:82059:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:3.0:1767317513.394040:0:82059:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:3.0:1767317513.394044:0:82059:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0e0 00000080:00010000:3.0:1767317513.394049:0:82059:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:3.0:1767317513.394061:0:82059:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0e0 from it ffffa7f7c1483cd8 00010000:00010000:3.0:1767317513.394063:0:82059:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.394070:0:82059:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00000080:00200080:3.0:1767317513.394148:0:82059:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=801066da arg=7ffd0fd9f360 00000080:00200000:3.0:1767317513.394161:0:82059:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1767317513.394183:0:82059:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317513.394187:0:82059:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317513.394194:0:82059:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:2.0:1767317513.394454:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291679232:192.168.202.133@tcp:1:lfs.0 00000100:00100000:1.0:1767317513.395601:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291679104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317513.396818:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291679232:192.168.202.133@tcp:1:lfs.0 00000080:00200000:0.0:1767317513.397153:0:82059:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 2 00000080:00200000:0.0:1767317513.397242:0:82059:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov.set.flags 00010000:00010000:0.0:1767317513.397293:0:82059:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.397450:0:82059:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.397457:0:82059:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317513.397461:0:82059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d04d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a4e expref: -99 pid: 81905 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317513.397483:0:82059:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317513.397493:0:82059:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ea00 x1853164291679488/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 624/440 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317513.397518:0:82059:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291679488:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317513.397636:0:82059:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c00c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317513.399757:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.399799:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317513.399817:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379183360 00000100:00100000:2.0:1767317513.399829:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379183360 00000100:00100000:3.0:1767317513.399829:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317513.399855:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379183488 00000100:00100000:3.0:1767317513.399859:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379183488 00000100:00100000:2.0:1767317513.399984:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379183616 00000100:00100000:2.0:1767317513.399988:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379183616 00000100:00100000:3.0:1767317513.400072:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9464 00000100:00100000:3.0:1767317513.400085:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+7:15479:x1853164379183360:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.400126:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1767317513.400128:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9465 00000100:00100000:2.0:1767317513.400135:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+7:15479:x1853164379183488:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317513.400143:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317513.400215:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317513.400223:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+7:15479:x1853164379183360:12345-192.168.202.133@tcp:104: Request processed in 141us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.400231:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9464 00000100:00100000:3.0:1767317513.400252:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9466 00000100:00100000:3.0:1767317513.400259:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:15479:x1853164379183616:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317513.400266:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317513.400343:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1767317513.400350:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:15479:x1853164379183488:12345-192.168.202.133@tcp:104: Request processed in 216us (551us total) trans 0 rc 0/0 00010000:00010000:3.0:1767317513.400353:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1767317513.400358:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9465 00000100:00100000:3.0:1767317513.400358:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:15479:x1853164379183616:12345-192.168.202.133@tcp:104: Request processed in 100us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317513.400364:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9466 00010000:00010000:1.0:1767317513.401484:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1767317513.401496:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.401508:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317513.401514:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.401524:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401528:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767317513.401535:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.401535:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401543:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317513.401546:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401552:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401559:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401576:0:60279:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401612:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401618:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000002:00100000:1.0:1767317513.401622:0:63743:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2300 x1853164291677312/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317513.401647:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317513.401648:0:63743:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 2 is allocated opc 35, max 7 00010000:00010000:0.0:1767317513.401654:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d0b6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71b5f expref: -99 pid: 82054 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767317513.401654:0:63743:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291679872/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317513.401676:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317513.401679:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767317513.401679:0:63743:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_08:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:63743:1853164291679872:192.168.202.133@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1767317513.401693:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317513.401696:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401702:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401709:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317513.401724:0:60279:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767317513.401748:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401755:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317513.401762:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401768:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d0e0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71c00 expref: -99 pid: 82059 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.401779:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.401781:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317513.401783:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317513.401803:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291679744:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317513.401903:0:63743:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 11 seconds 00010000:00010000:1.0:1767317513.401925:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317513.401938:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291680000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317513.404944:0:63743:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_08:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:63743:1853164291679872:192.168.202.133@tcp:35:ldlm_bl.0 00000002:00100000:1.0:1767317513.404993:0:63743:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2300 x1853164291677312/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317513.405043:0:63743:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317513.405122:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.405131:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317513.405154:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.405163:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71bb3 expref: -99 pid: 82058 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.405188:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.405191:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317513.405193:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317513.405206:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317513.405224:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291680128:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317513.405622:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291679744:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317513.406764:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291680000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317513.407926:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291680128:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317513.408065:0:82059:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291679488:192.168.202.133@tcp:36:lfs.0 00000080:00200008:0.0:1767317513.408129:0:82059:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 100002 00000002:00100000:0.0:1767317513.408219:0:82059:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a38a80 x1853164291678720/t8589937265(8589937265) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317513.408233:0:82059:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317513.408238:0:82059:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c000 x1853164291680384/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317513.408263:0:82059:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291680384:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317513.408613:0:82059:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317513.410524:0:82059:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82059:1853164291680384:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317513.410561:0:82059:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a38a80 x1853164291678720/t8589937265(8589937265) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317513.421197:0:82060:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317513.421235:0:82060:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.421257:0:82060:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.421281:0:82060:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.421373:0:82060:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.421572:0:82060:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317513.421576:0:82060:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:2.0:1767317513.421584:0:82060:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c14bbbf8 00010000:00010000:2.0:1767317513.421588:0:82060:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.421596:0:82060:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.421611:0:82060:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317513.421626:0:82060:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c60eb2300, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1767317513.421632:0:82060:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:2.0:1767317513.421648:0:82060:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:2.0:1767317513.421706:0:82060:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82060 initiator: MDT0 00010000:00010000:2.0:1767317513.421712:0:82060:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82060 initiator: MDT0 00000020:00100000:2.0:1767317513.421723:0:82060:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317513.421736:0:82060:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3a680 x1853164291680640/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317513.421744:0:82060:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82060 initiator: MDT0 00000100:00100000:2.0:1767317513.421837:0:82060:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82060:1853164291680640:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.422149:0:82060:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bf000 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.424549:0:82060:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82060:1853164291680640:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.424577:0:82060:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424590:0:82060:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424595:0:82060:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424600:0:82060:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424606:0:82060:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424610:0:82060:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317513.424614:0:82060:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424619:0:82060:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424623:0:82060:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424628:0:82060:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317513.424633:0:82060:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82060 initiator: MDT0 00010000:00010000:1.0:1767317513.424651:0:82060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82060 initiator: MDT0 00000002:00100000:1.0:1767317513.424669:0:82060:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c46a3a680 x1853164291680640/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317513.424681:0:82060:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:1.0:1767317513.424843:0:82060:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317513.424907:0:82060:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.424924:0:82060:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.424936:0:82060:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.424944:0:82060:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.424950:0:82060:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317513.424953:0:82060:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:1.0:1767317513.424958:0:82060:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c14bbbb0 00010000:00010000:1.0:1767317513.424961:0:82060:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.424967:0:82060:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.424980:0:82060:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317513.424991:0:82060:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:1.0:1767317513.425026:0:82060:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=22603d0 00000100:00100000:1.0:1767317513.425096:0:82060:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82060:1853164291680768:192.168.202.133@tcp:34:lfs.0 00000100:00100000:1.0:1767317513.425188:0:82060:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.428167:0:82060:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82060:1853164291680768:192.168.202.133@tcp:34:lfs.0 00000080:00200008:1.0:1767317513.428480:0:82060:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:2.0:1767317513.445564:0:82062:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317513.445602:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.445621:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.445636:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.445642:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317513.445649:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317513.445652:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:2.0:1767317513.445660:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfb58 00010000:00010000:2.0:1767317513.445663:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317513.445669:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317513.445684:0:82062:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317513.445698:0:82062:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:2.0:1767317513.445702:0:82062:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317513.445714:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317513.445767:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82062 initiator: MDT0 00010000:00010000:2.0:1767317513.445773:0:82062:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82062 initiator: MDT0 00010000:00010000:2.0:1767317513.445793:0:82062:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82062 initiator: MDT0 00000100:00100000:2.0:1767317513.445826:0:82062:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291680896:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317513.445974:0:82062:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c546bfd80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317513.448767:0:82062:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291680896:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317513.448800:0:82062:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.448826:0:82062:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.448836:0:82062:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.448851:0:82062:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.448860:0:82062:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.449637:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.449644:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.449650:0:82062:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317513.449659:0:82062:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39180 x1853164291680896/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/824 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317513.449668:0:82062:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317513.449679:0:82062:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.449689:0:82062:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767317513.449696:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317513.449747:0:82062:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317513.449757:0:82062:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317513.449760:0:82062:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317513.449766:0:82062:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317513.449806:0:82062:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317513.450233:0:82062:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:0.0:1767317513.450239:0:82062:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff8c3c61730908): rc = 0 00000080:00200000:0.0:1767317513.450258:0:82062:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:0.0:1767317513.450271:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0ee 00000080:00010000:0.0:1767317513.450282:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:0.0:1767317513.450286:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0ee from it ffffa7f7c1dbfb20 00010000:00010000:0.0:1767317513.450291:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.450300:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317513.450350:0:82062:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317513.450357:0:82062:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:0.0:1767317513.450384:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317513.450462:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.450472:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317513.450478:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317513.450483:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:0.0:1767317513.450485:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0ee 00000080:00010000:0.0:1767317513.450488:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0ee from it ffffa7f7c1dbfcb8 00010000:00010000:0.0:1767317513.450490:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317513.450495:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317513.450553:0:82062:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317513.450563:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317513.450570:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.450575:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317513.450579:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317513.450581:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317513.450583:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317513.450585:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c1dbfbf8 00010000:00010000:0.0:1767317513.450586:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317513.450591:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317513.450597:0:82062:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317513.450603:0:82062:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:0.0:1767317513.450607:0:82062:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 44 00000080:00200008:0.0:1767317513.450615:0:82062:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154400 00000002:00010000:0.0:1767317513.450627:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767317513.450673:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82062 initiator: MDT0 00010000:00010000:0.0:1767317513.450678:0:82062:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82062 initiator: MDT0 00000020:00100000:0.0:1767317513.450689:0:82062:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317513.450696:0:82062:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c000 x1853164291681152/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317513.450707:0:82062:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82062 initiator: MDT0 00000100:00100000:0.0:1767317513.450728:0:82062:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681152:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317513.451169:0:82062:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c433c00c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.455295:0:82062:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681152:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.455341:0:82062:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.455355:0:82062:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.455370:0:82062:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.455385:0:82062:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.455410:0:82062:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317513.455425:0:82062:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317513.455441:0:82062:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317513.455455:0:82062:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.455466:0:82062:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317513.455494:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317513.455547:0:82062:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767317513.455558:0:82062:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 6 -> 6 00000080:00010000:1.0:1767317513.455562:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0f5 00000080:00010000:1.0:1767317513.455569:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0f5 from it ffffa7f7c1dbfbf0 00010000:00010000:1.0:1767317513.455572:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.455580:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317513.455605:0:82062:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767317513.455727:0:82062:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=7ffd8932a664 00000002:00010000:1.0:1767317513.455748:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767317513.455806:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82062 initiator: MDT0 00010000:00010000:1.0:1767317513.455814:0:82062:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82062 initiator: MDT0 00000020:00100000:1.0:1767317513.455827:0:82062:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317513.455834:0:82062:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291681408/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317513.455843:0:82062:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 82062 initiator: MDT0 00000100:00100000:1.0:1767317513.455863:0:82062:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681408:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317513.456407:0:82062:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317513.458979:0:82062:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681408:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317513.459013:0:82062:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459028:0:82062:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459043:0:82062:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459067:0:82062:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459081:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459090:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459097:0:82062:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.459109:0:82062:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c0380 x1853164291681408/t8589937270(8589937270) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317513.459123:0:82062:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0380 x1853164291681408/t8589937270(8589937270) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317513.459140:0:82062:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459179:0:82062:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767317513.459186:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767317513.459210:0:82062:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0380 x1853164291681408/t8589937270(8589937270) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317513.459219:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0fc 00000080:00010000:1.0:1767317513.459227:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0fc from it ffffa7f7c1dbfcc0 00010000:00010000:1.0:1767317513.459231:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.459238:0:82062:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317513.459652:0:82062:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317513.459664:0:82062:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), xattr lov 00000080:00200008:1.0:1767317513.459696:0:82062:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.459705:0:82062:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.459730:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.459740:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.459751:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.459758:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.459764:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.459768:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0ee 00000080:00010000:1.0:1767317513.459777:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0ee from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.459780:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.459789:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317513.460023:0:82062:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=2 00000080:00200008:1.0:1767317513.460031:0:82062:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317513.460036:0:82062:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317513.460045:0:82062:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317513.460419:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.460427:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317513.460432:0:82062:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317513.460436:0:82062:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317513.460438:0:82062:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0ee 00000080:00010000:1.0:1767317513.460441:0:82062:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0ee from it ffffa7f7c1dbfcd8 00010000:00010000:1.0:1767317513.460443:0:82062:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317513.460449:0:82062:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317513.460464:0:82062:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:1.0:1767317513.460474:0:82062:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317513.460491:0:82062:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317513.460494:0:82062:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317513.460507:0:82062:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.460516:0:82062:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:1.0:1767317513.460525:0:82062:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:1.0:1767317513.460532:0:82062:0:(cl_io.c:214:cl_io_rw_init()) header@000000009e5da47c[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:1.0:1767317513.460534:0:82062:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:1.0:1767317513.460536:0:82062:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:1.0:1767317513.460544:0:82062:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317513.460553:0:82062:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:1.0:1767317513.460556:0:82062:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767317513.460572:0:82062:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767317513.460587:0:82062:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317513.460591:0:82062:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c89b0, osc lock ffff8c3c60dd0000, flags 0x40000 00000080:00200000:1.0:1767317513.460599:0:82062:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:1.0:1767317513.460604:0:82062:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767317513.460607:0:82062:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317513.460608:0:82062:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8230, osc lock ffff8c3c60dd11d0, flags 0x400001002 00010000:00010000:1.0:1767317513.460657:0:82062:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317513.460663:0:82062:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317513.460724:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291681536:192.168.202.133@tcp:101:lfs.0 00000020:00200000:1.0:1767317513.460849:0:82062:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317513.462907:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.462930:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.462945:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.462957:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317513.462970:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317513.462981:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317513.462995:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.463002:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.463025:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317513.463031:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317513.463047:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291681536:192.168.202.133@tcp:101:lfs.0 00000080:00200000:1.0:1767317513.463122:0:82062:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767317513.463128:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.463130:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.463135:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8230 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.463138:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.463140:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8230 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.463158:0:82062:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:1.0:1767317513.463165:0:82062:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00010000:1.0:1767317513.463178:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317513.463181:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.463183:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c89b0 (ffff8c3c5a084ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317513.463186:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317513.463189:0:82062:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c89b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317513.463195:0:82062:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000020:00200000:1.0:1767317513.463202:0:82062:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.463205:0:82062:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317513.463215:0:82062:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317513.463220:0:82062:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000020:00200000:1.0:1767317513.463222:0:82062:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317513.463227:0:82062:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200080:1.0:1767317513.463244:0:82062:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317513.463412:0:82062:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) cmd=c00c66f3 arg=7ffd8932a674 00010000:00010000:1.0:1767317513.463425:0:82062:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.463476:0:82062:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 1/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317513.463483:0:82062:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317513.463503:0:82062:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681664:192.168.202.133@tcp:103:lfs.0 00000100:00100000:1.0:1767317513.463591:0:82062:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 11 seconds 00000100:00100000:1.0:1767317513.465780:0:82062:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681664:192.168.202.133@tcp:103:lfs.0 00010000:00010000:1.0:1767317513.465813:0:82062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d0fc lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71c77 expref: -99 pid: 82062 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317513.466197:0:82062:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0380 x1853164291681408/t8589937270(8589937270) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317513.466212:0:82062:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317513.466217:0:82062:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291681920/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317513.466242:0:82062:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681920:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317513.466374:0:82062:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43a78f00 going to sleep for 11 seconds 00000100:00100000:1.0:1767317513.469837:0:82062:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82062:1853164291681920:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317513.470248:0:82062:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0380 x1853164291681408/t8589937270(8589937270) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317513.470317:0:82062:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), flags 154000 00010000:00010000:1.0:1767317513.470357:0:82062:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317514.086025:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317515.112245:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1767317515.297470:0:36:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x89:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:3.0:1767317515.297492:0:36:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317515.297528:0:36:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x89:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317516.133409:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317517.157058:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317517.857915:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.858052:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.858094:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1767317517.858102:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291682048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.858135:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.858777:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.869514:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291682048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.869547:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.869564:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.872487:0:2520:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179876002 gen 2 00000100:00100000:3.0:1767317517.872548:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317517.880531:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291682304:192.168.202.133@tcp:400:kworker.0 00010000:00010000:2.0:1767317518.186186:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317519.204530:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317520.225428:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.249786:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1767317521.329226:0:82627:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 212b: Testing lfs mirror verify --stale option ========================================================== 20:31:59 (1767317519) 00000080:00200000:0.0:1767317521.435423:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.435489:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.435515:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.435536:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.435545:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.435555:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.435559:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.435568:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3b58 00010000:00010000:0.0:1767317521.435572:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.435582:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.435615:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.435633:0:82630:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=13 00000080:00200000:0.0:1767317521.435639:0:82630:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317521.435656:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.435726:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.435735:0:82630:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.435748:0:82630:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00000100:00100000:0.0:1767317521.435782:0:82630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291682688:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.435964:0:82630:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.446815:0:82630:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937271 gen 1 00000100:00100000:0.0:1767317521.446856:0:82630:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317521.446900:0:82630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291682688:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.446921:0:82630:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.446936:0:82630:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.446944:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.446965:0:82630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.446974:0:82630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.446991:0:82630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317521.447269:0:82630:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.447278:0:82630:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.447285:0:82630:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.447292:0:82630:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317521.447301:0:82630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.447308:0:82630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82630 initiator: MDT0 00000002:00100000:0.0:1767317521.447339:0:82630:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8c3c50e9df80 x1853164291682688/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/584 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317521.447355:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1767317521.447390:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447405:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317521.447426:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3940 00010000:00010000:0.0:1767317521.447443:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447452:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.447532:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.447551:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.447558:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447568:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.447575:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.447580:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.447584:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.447590:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3be8 00010000:00010000:0.0:1767317521.447593:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447600:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.447607:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.447615:0:82630:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=16392 00000080:00200008:0.0:1767317521.447638:0:82630:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1767317521.447649:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.447656:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.447662:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447670:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.447677:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.447681:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.447684:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.447688:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3cb8 00010000:00010000:0.0:1767317521.447691:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.447697:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317521.448335:0:82630:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1767317521.448341:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.448353:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.448362:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448372:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448379:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.448384:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.448391:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.448395:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3cb8 00010000:00010000:0.0:1767317521.448399:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448407:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448517:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.448526:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.448534:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448542:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448548:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.448553:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.448555:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.448559:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3b58 00010000:00010000:0.0:1767317521.448563:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448569:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448578:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.448584:0:82630:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=8 00000080:00200000:0.0:1767317521.448600:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.448613:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.448620:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448628:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448635:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.448638:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.448640:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.448644:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3bf8 00010000:00010000:0.0:1767317521.448646:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448653:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448661:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.448666:0:82630:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=777 00000080:00200000:0.0:1767317521.448669:0:82630:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.448675:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.448679:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448686:0:82630:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448692:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.448694:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.448697:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d069 00000080:00010000:0.0:1767317521.448705:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d069 from it ffffa7f7c0dd3b38 00010000:00010000:0.0:1767317521.448707:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448714:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.448722:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317521.448728:0:82630:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c49af0f00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1767317521.448738:0:82630:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:0.0:1767317521.448763:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1767317521.448775:0:82630:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448831:0:82630:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448839:0:82630:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317521.448842:0:82630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71a7f expref: -99 pid: 82050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.448907:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.448914:0:82630:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00000020:00100000:0.0:1767317521.448926:0:82630:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317521.448937:0:82630:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9df80 x1853164291682944/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317521.448957:0:82630:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00000100:00100000:0.0:1767317521.448983:0:82630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291682944:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.449168:0:82630:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.464692:0:82630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291682944:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.464731:0:82630:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464775:0:82630:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464785:0:82630:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464799:0:82630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464811:0:82630:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464826:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464835:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.464843:0:82630:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.465973:0:82630:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8c3c50e9df80 x1853164291682944/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317521.466018:0:82630:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9df80 x1853164291682944/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.466043:0:82630:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.466060:0:82630:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.466067:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317521.466085:0:82630:0:(namei.c:1569:ll_create_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000080:00200000:0.0:1767317521.466135:0:82630:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00200000:0.0:1767317521.466144:0:82630:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 0 00000080:00200000:0.0:1767317521.466241:0:82630:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1767317521.466247:0:82630:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317521.466251:0:82630:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d111 00000080:00010000:0.0:1767317521.466276:0:82630:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00200008:0.0:1767317521.466295:0:82630:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 120501 00000002:00100000:0.0:1767317521.466332:0:82630:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9df80 x1853164291682944/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317521.466373:0:82630:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d111 from it ffff8c3c62906900 00010000:00010000:0.0:1767317521.466380:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.466390:0:82630:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.466792:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 40 00000080:00200000:0.0:1767317521.466911:0:82630:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 2 00000080:00200000:0.0:1767317521.466925:0:82630:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000002:00010000:0.0:1767317521.466950:0:82630:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1767317521.467042:0:82630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.467050:0:82630:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00000020:00100000:0.0:1767317521.467065:0:82630:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317521.467073:0:82630:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ea00 x1853164291683200/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317521.467083:0:82630:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00000100:00100000:0.0:1767317521.467110:0:82630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683200:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.467922:0:82630:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317521.474837:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317521.474952:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379186560 00000100:00100000:2.0:1767317521.474964:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379186560 00000100:00100000:2.0:1767317521.475100:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9467 00000100:00100000:2.0:1767317521.475112:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379186560:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317521.475136:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317521.475234:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317521.475241:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15477:x1853164379186560:12345-192.168.202.133@tcp:104: Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317521.475249:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9467 00010000:00010000:1.0:1767317521.475297:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317521.475306:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475324:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317521.475332:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475341:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475363:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317521.475395:0:63743:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317521.475461:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475469:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317521.475503:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475511:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d111 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71cb6 expref: -99 pid: 82630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.475532:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.475534:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.475536:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317521.475545:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317521.475565:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291683328:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317521.478989:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291683328:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317521.482569:0:82630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683200:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.482593:0:82630:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482606:0:82630:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482612:0:82630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482634:0:82630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482640:0:82630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482644:0:82630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cf200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317521.482648:0:82630:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482654:0:82630:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482659:0:82630:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482664:0:82630:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317521.482670:0:82630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82630 initiator: MDT0 00010000:00010000:0.0:1767317521.482674:0:82630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82630 initiator: MDT0 00000002:00100000:0.0:1767317521.482702:0:82630:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff8c3c50e9ea00 x1853164291683200/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317521.482717:0:82630:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ea00 x1853164291683200/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317521.482737:0:82630:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317521.482795:0:82630:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317521.482805:0:82630:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317521.482895:0:82630:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 0 00000002:00100000:0.0:1767317521.482913:0:82630:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ea00 x1853164291683200/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317521.484404:0:82630:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9ea00 x1853164291683200/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317521.484423:0:82630:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317521.487404:0:82630:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e680 x1853164291683584/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317521.487449:0:82630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683584:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317521.487570:0:82630:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1767317521.495960:0:82630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683584:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317521.496293:0:82630:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9ea00 x1853164291683200/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317521.496377:0:82630:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 100001 00000002:00100000:0.0:1767317521.496640:0:82630:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9df80 x1853164291682944/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317521.496653:0:82630:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317521.496659:0:82630:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291683840/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317521.496687:0:82630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683840:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317521.496793:0:82630:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1767317521.509550:0:82630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82630:1853164291683840:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317521.509603:0:82630:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9df80 x1853164291682944/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 536/608 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317521.514584:0:82495:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317521.514631:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317521.514732:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82495 initiator: MDT0 00010000:00010000:3.0:1767317521.514743:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00010000:00010000:3.0:1767317521.514754:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000100:00100000:3.0:1767317521.514918:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291683968:192.168.202.133@tcp:101:bash.0 00000100:00100000:3.0:1767317521.515549:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8840 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.539009:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291683968:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317521.539042:0:82495:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539065:0:82495:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539099:0:82495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539112:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539125:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539134:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539141:0:82495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317521.539165:0:82495:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc2300 x1853164291683968/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.539182:0:82495:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539199:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317521.539207:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317521.539243:0:82495:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317521.539250:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d11f 00000080:00010000:1.0:1767317521.539257:0:82495:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317521.539260:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d11f from it ffffa7f7c16e7bf8 00010000:00010000:1.0:1767317521.539263:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539280:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317521.539311:0:82495:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317521.539360:0:82495:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317521.539383:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317521.539393:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539404:0:82495:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317521.539411:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317521.539415:0:82495:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317521.539418:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d11f 00000080:00010000:1.0:1767317521.539422:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d11f from it ffffa7f7c16e7b38 00010000:00010000:1.0:1767317521.539740:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539751:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317521.539761:0:82495:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317521.539768:0:82495:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c50cb6780, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1767317521.539780:0:82495:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open|creat 00000002:00010000:1.0:1767317521.539807:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x200000405:0x91:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1767317521.539821:0:82495:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539930:0:82495:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539938:0:82495:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317521.539941:0:82495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d11f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71ce0 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.539986:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82495 initiator: MDT0 00010000:00010000:1.0:1767317521.540005:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000020:00100000:1.0:1767317521.540019:0:82495:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317521.540029:0:82495:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291684224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317521.540039:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000100:00100000:1.0:1767317521.540071:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684224:192.168.202.133@tcp:101:bash.0 00000100:00100000:1.0:1767317521.540260:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907180 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.547039:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684224:192.168.202.133@tcp:101:bash.0 00010000:00010000:0.0:1767317521.547602:0:82495:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547651:0:82495:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547660:0:82495:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547674:0:82495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547687:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547703:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547727:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.547736:0:82495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.547751:0:82495:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317521.547793:0:82495:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.547809:0:82495:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317521.547825:0:82495:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.547838:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.547846:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317521.547959:0:82495:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:0.0:1767317521.548540:0:82495:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317521.548551:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d126 00000080:00010000:0.0:1767317521.548566:0:82495:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00200008:0.0:1767317521.548586:0:82495:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 101101 00000002:00100000:0.0:1767317521.548622:0:82495:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 880/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317521.548664:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d126 from it ffff8c3c432f85a0 00010000:00010000:0.0:1767317521.548670:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.548682:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.548708:0:82495:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 42 00000002:00010000:0.0:1767317521.548747:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x90:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1767317521.548808:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82495 initiator: MDT0 00010000:00010000:0.0:1767317521.548816:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00010000:00010000:0.0:1767317521.548827:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000100:00100000:0.0:1767317521.548852:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684352:192.168.202.133@tcp:101:bash.0 00000100:00100000:0.0:1767317521.549040:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bc00 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.558780:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684352:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317521.558814:0:82495:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.558835:0:82495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.558893:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317521.558912:0:82495:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff8c3c50e9d180 x1853164291684352/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 568/1440 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.558925:0:82495:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.558941:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317521.558949:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x90:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1767317521.558979:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d12d 00000080:00010000:1.0:1767317521.559001:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d12d from it ffffa7f7c16e7a48 00010000:00010000:1.0:1767317521.559007:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.559024:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317521.559082:0:82495:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767317521.000000000, mtime 1767317521.000000000, ctime 1767317521.000000000 00010000:00010000:1.0:1767317521.559119:0:82495:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.559144:0:82495:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317521.559605:0:82495:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.559615:0:82495:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317521.559627:0:82495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d126 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71cfc expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317521.559655:0:82495:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317521.559664:0:82495:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291684608/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317521.559693:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684608:192.168.202.133@tcp:36:bash.0 00000100:00100000:1.0:1767317521.559811:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c439073c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.569524:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684608:192.168.202.133@tcp:36:bash.0 00000080:00200000:1.0:1767317521.569595:0:82495:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767317521.569604:0:82495:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00010000:00010000:1.0:1767317521.569630:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767317521.569649:0:82495:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:1.0:1767317521.569663:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317521.569732:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82495 initiator: MDT0 00010000:00010000:1.0:1767317521.569743:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00010000:00010000:1.0:1767317521.569755:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000100:00100000:1.0:1767317521.569781:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684736:192.168.202.133@tcp:101:bash.0 00000100:00100000:1.0:1767317521.571754:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c439073c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.596638:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684736:192.168.202.133@tcp:101:bash.0 00010000:00010000:0.0:1767317521.596678:0:82495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.596696:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317521.596713:0:82495:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c2d80 x1853164291684736/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.596726:0:82495:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317521.596743:0:82495:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.596759:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.596767:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317521.596791:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d134 00000080:00010000:0.0:1767317521.596801:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d134 from it ffffa7f7c16e78c8 00010000:00010000:0.0:1767317521.596826:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.596835:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.596864:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.596905:0:82495:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317521.596915:0:82495:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.596974:0:82495:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1767317521.596996:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.597003:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767317521.597028:0:82495:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x90:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1767317521.597038:0:82495:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317521.597042:0:82495:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x90:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1767317521.597061:0:82495:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:0.0:1767317521.597073:0:82495:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 02 00010000:00010000:0.0:1767317521.597090:0:82495:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.597117:0:82495:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317521.597165:0:82495:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.597173:0:82495:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317521.597176:0:82495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d134 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d1f expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.597204:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82495 initiator: MDT0 00010000:00010000:0.0:1767317521.597210:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000020:00100000:0.0:1767317521.597222:0:82495:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317521.597230:0:82495:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c700 x1853164291684992/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317521.597238:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82495 initiator: MDT0 00000100:00100000:0.0:1767317521.597262:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684992:192.168.202.133@tcp:101:bash.0 00000100:00100000:0.0:1767317521.597388:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b6c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.612747:0:82495:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937279 gen 1 00000100:00100000:0.0:1767317521.612856:0:82495:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 880/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317521.613014:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291684992:192.168.202.133@tcp:101:bash.0 00010000:00010000:0.0:1767317521.613045:0:82495:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613069:0:82495:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 4/0,1 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613085:0:82495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613099:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613115:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613124:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613132:0:82495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317521.613143:0:82495:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9c700 x1853164291684992/t8589937279(8589937279) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.613163:0:82495:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317521.613175:0:82495:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613190:0:82495:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.613199:0:82495:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317521.613219:0:82495:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d13b 00000080:00010000:0.0:1767317521.613230:0:82495:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d13b from it ffffa7f7c16e7930 00010000:00010000:0.0:1767317521.613234:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613243:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.613266:0:82495:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1767317521.613274:0:82495:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1767317521.613292:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613305:0:82495:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317521.613314:0:82495:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613370:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.613378:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.613393:0:82495:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317521.613404:0:82495:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317521.613408:0:82495:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317521.613417:0:82495:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317521.613452:0:82495:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317521.615033:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.615051:0:82495:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317521.615060:0:82495:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.615099:0:82495:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317521.615107:0:82495:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317521.615111:0:82495:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317521.615117:0:82495:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317521.615139:0:82495:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317521.615225:0:82495:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1767317521.615231:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.615241:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767317521.615261:0:82495:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x90:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1767317521.615265:0:82495:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317521.615267:0:82495:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317521.615274:0:82495:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317521.615284:0:82495:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767317521.615298:0:82495:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1767317521.615303:0:82495:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287c30, osc lock ffff8c3c50c8fdb0, flags 0x80000000 00010000:00010000:0.0:1767317521.615379:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.615398:0:82495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.615410:0:82495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317521.615442:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291685120:192.168.202.133@tcp:101:bash.0 00000100:00100000:0.0:1767317521.615972:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767317521.621551:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291685120:192.168.202.133@tcp:101:bash.0 00010000:00010000:1.0:1767317521.621596:0:82495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.621633:0:82495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.621652:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317521.621667:0:82495:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.621680:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.621689:0:82495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317521.622445:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291685248:192.168.202.133@tcp:10:bash.0 00000100:00100000:1.0:1767317521.651173:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291685248:192.168.202.133@tcp:10:bash.0 00000080:00200000:3.0:1767317521.652024:0:82495:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1767317521.652036:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:3.0:1767317521.652041:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.652047:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287c30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317521.652071:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652088:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317521.652108:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317521.652112:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287c30 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317521.652138:0:82495:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317521.652166:0:82495:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767317521.000000000, mtime 1767317521.000000000, ctime 1767317521.000000000, rc 0 00000080:00200008:3.0:1767317521.652285:0:82495:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767317521.652303:0:82495:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 29 bytes 00000080:00200000:3.0:1767317521.652311:0:82495:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 29 00000080:00200000:3.0:1767317521.652329:0:82495:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 29 00000080:00200000:3.0:1767317521.652336:0:82495:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767317521.652345:0:82495:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 1, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317521.652348:0:82495:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 29) 0 0 00000080:00200000:3.0:1767317521.652353:0:82495:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767317521.652369:0:82495:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x90:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:3.0:1767317521.652375:0:82495:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317521.652378:0:82495:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317521.652385:0:82495:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317521.652394:0:82495:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317521.652398:0:82495:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317521.652417:0:82495:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767317521.652447:0:82495:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1767317521.652454:0:82495:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec4b0, osc lock ffff8c3c60cb4ab0, flags 0x0 00010000:00010000:3.0:1767317521.652480:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652510:0:82495:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652525:0:82495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652533:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652541:0:82495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317521.652555:0:82495:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 29) append 0 append lockpos 0 00000080:00200000:3.0:1767317521.652565:0:82495:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 29 bytes 00000080:00200000:3.0:1767317521.652620:0:82495:0:(rw26.c:912:ll_write_end()) pos 0, len 29, copied 29 00000080:00200000:3.0:1767317521.652630:0:82495:0:(rw26.c:969:ll_write_end()) page@000000001b58319b[3 00000000479d718f 2 1 000000002d7e3984] 00000080:00200000:3.0:1767317521.652635:0:82495:0:(rw26.c:969:ll_write_end()) vmpage @00000000b516d51d 17ffffc0001001 3:0 ffff8c3c50eb3e58 0 lru 00000080:00200000:3.0:1767317521.652643:0:82495:0:(rw26.c:969:ll_write_end()) osc-page@0000000043891563 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000006de10af5 00000000ce3f0902 > 3< 0 0 > 4< 0 0 8 125116416 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1767317521.652646:0:82495:0:(rw26.c:969:ll_write_end()) end page@000000001b58319b 00000080:00200000:3.0:1767317521.652647:0:82495:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:3.0:1767317521.652653:0:82495:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 29 prio 0 00000008:00010000:3.0:1767317521.652679:0:82495:0:(osc_cache.c:814:osc_extent_find()) ### extent: 00000000769e7870 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317521.652701:0:82495:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff8c3c61732bb8, count 1, dirtied 1 00000080:00200000:3.0:1767317521.652706:0:82495:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 29 bytes, tot: 29 00000080:00200000:3.0:1767317521.652710:0:82495:0:(vvp_io.c:1390:vvp_io_write_start()) f212b.sanity-flr: write bytes 0, result: 29 00000020:00010000:3.0:1767317521.652735:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:3.0:1767317521.652738:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.652741:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec4b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317521.652745:0:82495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.652754:0:82495:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317521.652764:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317521.652766:0:82495:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec4b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317521.652773:0:82495:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000080:00200000:3.0:1767317521.652777:0:82495:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317521.652782:0:82495:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317521.652786:0:82495:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 29, restart: 0 00000080:00200000:3.0:1767317521.652793:0:82495:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000080:00200000:3.0:1767317521.652796:0:82495:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 29 00000080:00200008:3.0:1767317521.652815:0:82495:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 100001 00000002:00100000:3.0:1767317521.652920:0:82495:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 880/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317521.652933:0:82495:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317521.652939:0:82495:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0380 x1853164291685504/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317521.652963:0:82495:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291685504:192.168.202.133@tcp:35:bash.0 00000100:00100000:3.0:1767317521.653084:0:82495:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317521.657405:0:82495:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82495:1853164291685504:192.168.202.133@tcp:35:bash.0 00000002:00100000:0.0:1767317521.657562:0:82495:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1500 x1853164291684224/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 880/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317521.705163:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.705208:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.705298:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.705310:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.705333:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:0.0:1767317521.705368:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291685632:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.705513:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bf00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.708810:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291685632:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.708863:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709747:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709762:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709775:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709790:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709799:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709807:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.709821:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291685632/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.709838:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.709856:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317521.709866:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317521.709995:0:82640:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317521.710024:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317521.710033:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.710036:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0dd3b58 00010000:00010000:0.0:1767317521.710040:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.710049:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.710084:0:82640:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.710115:0:82640:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:0.0:1767317521.710121:0:82640:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317521.710153:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.710211:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.710219:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.710231:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:0.0:1767317521.710261:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291685760:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.710389:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bf00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.714629:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291685760:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.714665:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714687:0:82640:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714719:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714733:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714746:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714761:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714769:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.714777:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.714792:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291685760/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.714804:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317521.714819:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.714831:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.714840:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317521.715543:0:82640:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:0.0:1767317521.715567:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1767317521.715574:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d150 00000080:00010000:0.0:1767317521.715590:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317521.715594:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d150 from it ffffa7f7c0dd3b20 00010000:00010000:0.0:1767317521.715599:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.715610:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317521.715659:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317521.715667:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317521.715697:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.715707:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.715718:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.715726:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.715731:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317521.715735:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d150 00000080:00010000:0.0:1767317521.715739:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d150 from it ffffa7f7c0dd3cb8 00010000:00010000:0.0:1767317521.715742:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317521.715749:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317521.715788:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317521.715801:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317521.715804:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317521.715809:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317521.715830:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317521.715833:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287330, osc lock ffff8c3c50c8fb50, flags 0x400000400001002 00010000:00010000:0.0:1767317521.715851:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.715860:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317521.716274:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317521.716280:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.716289:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317521.716302:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317521.716609:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000020:00010000:0.0:1767317521.716619:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_release():245 00000020:00010000:0.0:1767317521.716623:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317521.716627:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287330 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317521.716633:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317521.716636:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287330 (ffff8c3c547fdd88/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317521.716650:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317521.716724:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317521.716743:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.716755:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.716765:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.716773:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317521.716779:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317521.716783:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317521.716788:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0dd3bf8 00010000:00010000:0.0:1767317521.716791:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.716799:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317521.716810:0:82640:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317521.716819:0:82640:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767317521.716826:0:82640:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 46 00000080:00200008:0.0:1767317521.716837:0:82640:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154402 00000002:00010000:0.0:1767317521.716855:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1767317521.717372:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.717382:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000020:00100000:0.0:1767317521.717396:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317521.717420:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291686016/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317521.717526:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:0.0:1767317521.717558:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686016:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.717900:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317521.723389:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317521.723665:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317521.723693:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379187072 00000100:00100000:2.0:1767317521.723704:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379187072 00000100:00100000:2.0:1767317521.723779:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9468 00000100:00100000:2.0:1767317521.723791:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379187072:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317521.723814:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317521.724311:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317521.724329:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379187072:12345-192.168.202.133@tcp:104: Request processed in 539us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317521.724339:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9468 00010000:00010000:1.0:1767317521.724605:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317521.724615:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724625:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cec00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317521.724631:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724641:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724664:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724697:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724752:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.724759:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317521.724833:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686144:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317521.725261:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.725271:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cec00/0x73c3d5cb1442d150 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71d5e expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.725292:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.725294:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.725296:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317521.734095:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686144:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317521.735497:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686016:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317521.735536:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735562:0:82640:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735571:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735587:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735601:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735618:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735652:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735659:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.735672:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317521.735686:0:82640:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317521.735704:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735716:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317521.735723:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317521.735786:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d157 00000080:00010000:0.0:1767317521.735796:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d157 from it ffffa7f7c0dd3bf0 00010000:00010000:0.0:1767317521.735799:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.735806:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317521.735838:0:82640:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317521.737357:0:82640:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317521.737383:0:82640:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:0.0:1767317521.737445:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317521.737456:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317521.737481:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317521.737498:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767317521.737565:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.737575:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317521.737586:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:0.0:1767317521.737617:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686272:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317521.737755:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8bf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317521.740379:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317521.742842:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379187200 00000100:00100000:2.0:1767317521.742864:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379187200 00000100:00100000:2.0:1767317521.743386:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9469 00000100:00100000:2.0:1767317521.743401:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379187200:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317521.743435:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317521.743563:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317521.743571:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379187200:12345-192.168.202.133@tcp:104: Request processed in 174us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317521.743580:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9469 00010000:00010000:0.0:1767317521.743912:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317521.743932:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.743943:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317521.743950:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.743960:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.743968:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.744096:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.744103:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317521.744184:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291686400:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317521.744833:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.744843:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d157 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d6c expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317521.744863:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317521.744865:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317521.744867:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317521.757534:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686272:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317521.757571:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757585:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757600:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757633:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757648:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757656:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.757664:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317521.757677:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291686272/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.757690:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317521.757705:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.757722:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317521.757729:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317521.757808:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767317521.757814:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d15e 00000080:00010000:1.0:1767317521.757821:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317521.757824:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d15e from it ffffa7f7c0dd3cd8 00010000:00010000:1.0:1767317521.757827:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.757842:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.757937:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317521.757951:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.757954:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317521.757959:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767317521.757981:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317521.757985:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8330, osc lock ffff8c3c60dd0000, flags 0x400000400001002 00010000:00010000:1.0:1767317521.758004:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.758027:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.758041:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317521.758046:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.758054:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.758065:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317521.758077:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000020:00010000:1.0:1767317521.758085:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.758088:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.758091:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8330 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.758102:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.758105:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8330 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.758117:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767317521.758193:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=ad52a0 00000002:00010000:1.0:1767317521.758226:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1767317521.758293:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:1.0:1767317521.758302:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000020:00100000:1.0:1767317521.758328:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317521.758336:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291686656/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317521.758346:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82640 initiator: MDT0 00000100:00100000:1.0:1767317521.758371:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686656:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317521.758614:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317521.760176:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291686400:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317521.765686:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291686656:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317521.765723:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765738:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765754:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765797:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765814:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765822:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765830:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317521.765844:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317521.765857:0:82640:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.765900:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.765917:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317521.766166:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767317521.766197:0:82640:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767317521.766207:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d165 00000080:00010000:1.0:1767317521.766215:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d165 from it ffffa7f7c0dd3cc0 00010000:00010000:1.0:1767317521.766219:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.766235:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317521.766309:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767317521.766332:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.766336:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317521.766343:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767317521.767011:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686784:192.168.202.133@tcp:1:lfs.0 00000100:00100000:3.0:1767317521.776833:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317521.777066:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379187328 00000100:00100000:2.0:1767317521.777081:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379187328 00000100:00100000:2.0:1767317521.777157:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9470 00000100:00100000:2.0:1767317521.777170:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:40595:x1853164379187328:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317521.777196:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.777303:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317521.777311:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:40595:x1853164379187328:12345-192.168.202.133@tcp:104: Request processed in 144us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317521.777348:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9470 00010000:00010000:0.0:1767317521.778284:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317521.778299:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.778324:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821cf000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317521.778334:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317521.778369:0:42098:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 00000000769e7870 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317521.778405:0:42098:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 00000000769e7870 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.778500:0:42098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000008:00100000:0.0:1767317521.778607:0:42098:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9ea00 - object 0x280000400:161 offset 0<>29 00000100:00100000:0.0:1767317521.778680:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317521.778702:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686912:192.168.202.133@tcp:4:bash.0 00000008:00010000:0.0:1767317521.788516:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 00000000769e7870 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317521.788656:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 00000000769e7870 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317521.788695:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686912:192.168.202.133@tcp:4:bash.0 00000080:00200000:1.0:1767317521.788849:0:42098:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317521.789068:0:42098:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317521.789138:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.789147:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317521.789207:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291687040:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317521.789637:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.789648:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c821cf000/0x73c3d5cb1442d142 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x541306ba06a71d34 expref: -99 pid: 82495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.789681:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.789684:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317521.789685:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317521.793629:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291687040:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317521.793730:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291686784:192.168.202.133@tcp:1:lfs.0 00010000:00010000:1.0:1767317521.794532:0:82640:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.794592:0:82640:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317521.794613:0:82640:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.794623:0:82640:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317521.794671:0:82640:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.794678:0:82640:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.794683:0:82640:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317521.794687:0:82640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce400/0x73c3d5cb1442d13b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d2d expref: -99 pid: 82495 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.794703:0:82640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d15e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71d81 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317521.794732:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317521.794745:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3800 x1853164291687296/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317521.794775:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687296:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317521.794922:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.804761:0:82640:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937283 gen 1 00000100:00100000:1.0:1767317521.804790:0:82640:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317521.804812:0:82640:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317521.804847:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687296:192.168.202.133@tcp:36:lfs.0 00010000:00010000:1.0:1767317521.804936:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767317521.804950:0:82640:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:1.0:1767317521.804965:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767317521.805042:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:1.0:1767317521.805052:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:1.0:1767317521.805064:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:1.0:1767317521.805089:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687424:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317521.805284:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.814673:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687424:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317521.814729:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.814749:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317521.814767:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c437c3800 x1853164291687424/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.814779:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767317521.814830:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.814847:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317521.814856:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317521.814930:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d16c 00000080:00010000:1.0:1767317521.814942:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d16c from it ffffa7f7c0dd3c70 00010000:00010000:1.0:1767317521.814946:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.814957:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815003:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815017:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317521.815025:0:82640:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815076:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815085:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.815116:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317521.815129:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.815133:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317521.815141:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317521.815176:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767317521.815190:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815197:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317521.815204:0:82640:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.815220:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317521.815225:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.815227:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317521.815230:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317521.815238:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317521.815739:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1767317521.815747:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.815757:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317521.815784:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=ffffffffffffffff 00000080:00200008:1.0:1767317521.815801:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317521.815819:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:1.0:1767317521.815837:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317521.815845:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767317521.815954:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:1.0:1767317521.815962:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:1.0:1767317521.816339:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:1.0:1767317521.816556:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687552:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317521.816680:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317521.823188:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291687552:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317521.823221:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823236:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823250:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823272:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823285:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823324:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317521.823333:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317521.823346:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3800 x1853164291687552/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317521.823360:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317521.823385:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.823402:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317521.823411:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317521.823486:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767317521.823492:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:1.0:1767317521.823498:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317521.823501:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:1.0:1767317521.823505:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.823514:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.823568:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767317521.823587:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.823590:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317521.823596:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767317521.823618:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317521.823623:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x400000400001002 00010000:00010000:1.0:1767317521.823684:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.823693:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.823703:0:82640:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c437c3800 x1853164291687680/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317521.823809:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291687680:192.168.202.133@tcp:101:lfs.0 00000020:00200000:1.0:1767317521.824148:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317521.832655:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832690:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832744:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832760:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317521.832781:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317521.832796:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317521.832826:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832835:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832842:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317521.832852:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317521.832916:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291687680:192.168.202.133@tcp:101:lfs.0 00000080:00200000:1.0:1767317521.833181:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317521.833190:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.833194:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.833200:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.833205:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11ff0 (ffff8c3c547fdd88/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.833208:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c547fdd88/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.833224:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1767317521.923196:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317521.923228:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317521.923241:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317521.923287:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317521.923323:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317521.923342:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317521.923352:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317521.923365:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317521.923370:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:3.0:1767317521.923379:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:3.0:1767317521.923383:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317521.923393:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317521.923429:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767317521.923444:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317521.923447:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317521.923452:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317521.923475:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317521.923478:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec1b0, osc lock ffff8c3c60cb4ab0, flags 0x400000400001002 00010000:00010000:3.0:1767317521.923497:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.923521:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317521.923536:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317521.923540:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.923547:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317521.923558:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317521.923571:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767317521.923575:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:3.0:1767317521.923579:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.923582:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec1b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.923586:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317521.923589:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec1b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317521.923601:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317521.923621:0:82640:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:3.0:1767317521.923627:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1767317521.923632:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317521.923634:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317521.923639:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317521.923659:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:3.0:1767317521.923668:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317521.923675:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767317521.923685:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317521.923690:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317521.923695:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767317521.923702:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767317521.923704:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec1b0, osc lock ffff8c3c60cb4ab0, flags 0x0 00010000:00010000:3.0:1767317521.924387:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.924406:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.924418:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.924427:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.924435:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317521.924450:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:2.0:1767317521.924965:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291687808:192.168.202.133@tcp:23:lfs.0 00000100:00100000:3.0:1767317521.933197:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291687808:192.168.202.133@tcp:23:lfs.0 00000020:00010000:1.0:1767317521.933386:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.933392:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.933399:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec1b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317521.933413:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.933428:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317521.933465:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.933469:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec1b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.933487:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317521.933500:0:82640:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1767317521.933515:0:82640:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1767317521.933524:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317521.933533:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.933537:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317521.933544:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317521.933571:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:1.0:1767317521.933576:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317521.933582:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767317521.933584:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317521.933589:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317521.933593:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767317521.933607:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767317521.933611:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x0 00010000:00010000:1.0:1767317521.933636:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.933650:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.933662:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.933685:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.933692:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317521.933704:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:0.0:1767317521.934032:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291687936:192.168.202.133@tcp:23:lfs.0 00000100:00100000:0.0:1767317521.938207:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291687936:192.168.202.133@tcp:23:lfs.0 00000020:00010000:1.0:1767317521.938398:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.938403:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.938410:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317521.938425:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.938442:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317521.938463:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.938466:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.938487:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317521.938502:0:82640:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE, rc = 29 00000080:00200080:1.0:1767317521.938519:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317521.938532:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:1.0:1767317521.938540:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317521.938548:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:1.0:1767317521.938576:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317521.938618:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.938632:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.938641:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317521.938650:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317521.938655:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:1.0:1767317521.938662:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:1.0:1767317521.938665:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.938673:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.938696:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767317521.938707:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.939555:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317521.939564:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767317521.939594:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317521.939599:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x400000400001002 00010000:00010000:1.0:1767317521.939620:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.939635:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.939649:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317521.939666:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.939675:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.939689:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317521.939704:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317521.939791:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.939797:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.939800:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.943144:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.943151:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.943393:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317521.943452:0:82640:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767317521.943465:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317521.943477:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.943481:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767317521.943492:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317521.943499:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1767317521.943504:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.943507:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317521.943511:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767317521.943539:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317521.943543:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x400000400001002 00010000:00010000:1.0:1767317521.943575:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.943622:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.943640:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317521.943644:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.943655:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.943675:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317521.943684:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317521.943689:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.943691:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.943694:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.943698:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b10490 (ffff8c3c547fdc68/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.943700:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.943707:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317521.943794:0:82640:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 4096] over eof, kms 29, file_size 29. 00000080:00200000:1.0:1767317521.943941:0:82640:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:1.0:1767317521.943957:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:1.0:1767317521.943967:0:82640:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767317521.943970:0:82640:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:1.0:1767317521.943973:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767317521.944236:0:82640:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317521.944247:0:82640:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:1.0:1767317521.944252:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317521.944371:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767317521.944384:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317521.944388:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x40000 00000080:00200000:1.0:1767317521.944396:0:82640:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:1.0:1767317521.944405:0:82640:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:1.0:1767317521.944413:0:82640:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:1.0:1767317521.944478:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317521.944481:0:82640:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:1.0:1767317521.944488:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.944491:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.944494:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.944497:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.944500:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.944507:0:82640:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:1.0:1767317521.944513:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317521.944546:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319b40 00000008:00100000:1.0:1767317521.944606:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c0e00 - object 0x280000400:161 offset 0<>29 00000100:00100000:0.0:1767317521.944927:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317521.944955:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291688064:192.168.202.133@tcp:3:lfs.0 00000008:00010000:0.0:1767317521.950614:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319b40 00000020:00200000:0.0:1767317521.950632:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317521.950643:0:2517:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:0.0:1767317521.950656:0:2517:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767317521.950673:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317521.950694:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319b40 00000100:00100000:0.0:1767317521.950733:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291688064:192.168.202.133@tcp:3:lfs.0 00000080:00200000:1.0:1767317521.951677:0:82640:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317521.951698:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317521.951704:0:82640:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:1.0:1767317521.951708:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317521.951733:0:82640:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:1.0:1767317521.951757:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:1.0:1767317521.951770:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:1.0:1767317521.951779:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317521.951788:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:1.0:1767317521.951831:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317521.951856:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.951950:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.951960:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317521.951970:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317521.952649:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:1.0:1767317521.952665:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:1.0:1767317521.952670:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317521.952682:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317521.952730:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767317521.952744:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317521.952748:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317521.952753:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767317521.952778:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317521.952781:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x400000400001002 00010000:00010000:1.0:1767317521.952810:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.952821:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.952835:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317521.952839:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317521.952855:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317521.952867:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317521.952904:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317521.952909:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.952912:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.952916:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.952920:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.952923:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.952934:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317521.952969:0:82640:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767317521.952987:0:82640:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767317521.953245:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:1.0:1767317521.953500:0:82640:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767317521.953503:0:82640:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:1.0:1767317521.953506:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767317521.953519:0:82640:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767317521.953529:0:82640:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767317521.953534:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767317521.953550:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767317521.953560:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767317521.953563:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x40000 00000080:00200000:1.0:1767317521.953572:0:82640:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767317521.953607:0:82640:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767317521.953682:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317521.953685:0:82640:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1767317521.953697:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317521.953714:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:1.0:1767317521.953717:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.953720:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317521.953723:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317521.953726:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317521.953733:0:82640:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767317521.953739:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317521.953761:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a319540 00000008:00100000:1.0:1767317521.954426:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c0e00 - object 0x2c0000400:193 offset 0<>4096 00000100:00100000:0.0:1767317521.954499:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291688192:192.168.202.133@tcp:4:lfs.0 00000100:00100000:0.0:1767317521.967479:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805051 gen 3 00000008:00010000:0.0:1767317521.967544:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a319540 00000020:00200000:0.0:1767317521.967551:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317521.967561:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317521.967587:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a319540 00000100:00100000:0.0:1767317521.967619:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291688192:192.168.202.133@tcp:4:lfs.0 00000080:00200000:3.0:1767317521.967736:0:82640:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317521.967754:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317521.967760:0:82640:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767317521.967775:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00200000:3.0:1767317521.967779:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317521.967789:0:82640:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1767317521.967835:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317521.967848:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:3.0:1767317521.967857:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317521.967866:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317521.967928:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317521.967951:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317521.967966:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317521.967984:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317521.967993:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317521.968369:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:3.0:1767317521.968379:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:3.0:1767317521.968384:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317521.968395:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317521.968424:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1767317521.968436:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317521.968439:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317521.968445:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317521.968466:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317521.968469:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec4b0, osc lock ffff8c3c60cb4be0, flags 0x400000400001002 00010000:00010000:3.0:1767317521.968488:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.968512:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317521.968534:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317521.968538:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317521.968546:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317521.968557:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317521.968564:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767317521.968568:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:3.0:1767317521.968571:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.968575:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec4b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317521.968579:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317521.968582:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec4b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317521.968591:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317521.968609:0:82640:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767317521.968616:0:82640:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1767317521.968626:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:3.0:1767317521.968636:0:82640:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317521.968638:0:82640:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1767317521.968640:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1767317521.968653:0:82640:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317521.968663:0:82640:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1767317521.968675:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:3.0:1767317521.968693:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767317521.968703:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317521.968706:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec4b0, osc lock ffff8c3c60cb4be0, flags 0x40000 00000080:00200000:2.0:1767317521.970847:0:82640:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:2.0:1767317521.970904:0:82640:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317521.971440:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317521.971445:0:82640:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:2.0:1767317521.971464:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767317521.971471:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317521.971474:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.971478:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec4b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.971482:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317521.971485:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec4b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317521.971500:0:82640:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317521.971508:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317521.971535:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fe40 00000008:00100000:2.0:1767317521.971657:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3ad80 - object 0x280000400:162 offset 0<>4096 00000100:00100000:3.0:1767317521.972406:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291688320:192.168.202.133@tcp:4:lfs.0 00000100:00100000:3.0:1767317521.986017:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179876010 gen 2 00000008:00010000:3.0:1767317521.986100:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fe40 00000020:00200000:3.0:1767317521.986108:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317521.986118:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317521.986138:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fe40 00000080:00200000:2.0:1767317521.986602:0:82640:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317521.986623:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317521.986629:0:82640:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767317521.986644:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00200000:2.0:1767317521.986647:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317521.986658:0:82640:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1767317521.986684:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317521.986693:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317521.986701:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000100:00100000:3.0:1767317521.987074:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291688320:192.168.202.133@tcp:4:lfs.0 00000080:00200000:2.0:1767317521.987431:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317521.987480:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317521.987504:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317521.987546:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317521.987556:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317521.987565:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317521.987570:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:2.0:1767317521.987578:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:2.0:1767317521.987583:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317521.987593:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317521.987621:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1767317521.987635:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317521.987638:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317521.987643:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317521.987668:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317521.987672:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179cb0, osc lock ffff8c3c61004d10, flags 0x400000400001002 00010000:00010000:2.0:1767317521.987691:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.987702:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317521.988653:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317521.988663:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.988691:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317521.988706:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317521.988796:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767317521.988802:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317521.988806:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.988810:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179cb0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.988815:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317521.988818:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179cb0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317521.988834:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317521.988854:0:82640:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 29, type: SEEK_DATA 00000080:00200000:2.0:1767317521.988861:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767317521.988868:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317521.988964:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317521.989533:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317521.989564:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:2.0:1767317521.989575:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317521.989582:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1767317521.989584:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317521.989591:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317521.989596:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1767317521.989611:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1767317521.989615:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179cb0, osc lock ffff8c3c61004d10, flags 0x0 00010000:00010000:2.0:1767317521.989637:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.989668:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.989680:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.989689:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.989697:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317521.989783:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767317521.989791:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317521.989794:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.989797:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179cb0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767317521.989803:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.989813:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767317521.989824:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317521.989826:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179cb0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317521.989835:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317521.989852:0:82640:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1767317521.989859:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1767317521.989864:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317521.989867:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317521.989984:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317521.989999:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317521.990002:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179cb0, osc lock ffff8c3c61004d10, flags 0x400000400001002 00010000:00010000:2.0:1767317521.990011:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.990022:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317521.990038:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317521.990041:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317521.990050:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317521.990060:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317521.990066:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767317521.990068:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317521.990070:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.990073:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179cb0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317521.990076:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317521.990078:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179cb0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317521.990085:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317521.990100:0:82640:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null), rc = 29 00000080:00200080:2.0:1767317521.990109:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317522.008663:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:3.0:1767317522.008693:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317522.008769:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317522.008811:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.008839:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.008860:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317522.009390:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317522.009404:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317522.009408:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d173 00000080:00010000:3.0:1767317522.009420:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d173 from it ffffa7f7c0dd3cd8 00010000:00010000:3.0:1767317522.009425:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.009436:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317522.009496:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767317522.009512:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317522.009516:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317522.009521:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317522.009550:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317522.009555:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec4b0, osc lock ffff8c3c60cb51d0, flags 0x400000400001002 00010000:00010000:3.0:1767317522.009577:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.009588:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.009603:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317522.009608:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.009615:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.009627:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317522.009642:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767317522.009648:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.009651:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.009654:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec4b0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.009659:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.009663:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec4b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.009678:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317522.009744:0:82640:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000 00010000:00010000:3.0:1767317522.009777:0:82640:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.009797:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.009856:0:82640:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.009865:0:82640:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317522.009868:0:82640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d173 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71db9 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767317522.009926:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317522.009941:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3b80 x1853164291688576/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317522.009972:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688576:192.168.202.133@tcp:36:lfs.0 00000100:00100000:3.0:1767317522.010342:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8180 going to sleep for 12 seconds 00000100:00100000:3.0:1767317522.014552:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688576:192.168.202.133@tcp:36:lfs.0 00000080:00200000:3.0:1767317522.014615:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:3.0:1767317522.014625:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1767317522.014655:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:3.0:1767317522.014678:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1767317522.014695:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1767317522.014700:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec4b0, osc lock ffff8c3c60cb51d0, flags 0x0 00010000:00010000:3.0:1767317522.014792:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.014823:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.014836:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767317522.014861:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688704:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.015557:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1767317522.018491:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688704:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317522.018537:0:82640:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.018556:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.018574:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317522.018590:0:82640:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.018603:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.018612:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767317522.018768:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317522.018789:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291688832:192.168.202.133@tcp:10:lfs.0 00000100:00100000:3.0:1767317522.023704:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291688832:192.168.202.133@tcp:10:lfs.0 00000080:00200000:0.0:1767317522.024656:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767317522.024669:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.024675:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.024680:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec4b0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767317522.024694:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.024776:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767317522.025334:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.025339:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec4b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.025369:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317522.025385:0:82640:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000, rc 0 00000080:00200080:0.0:1767317522.025411:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317522.025421:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:0.0:1767317522.025430:0:82640:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.025439:0:82640:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.025468:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.025485:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767317522.025551:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317522.025560:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:0.0:1767317522.025571:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:0.0:1767317522.025603:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688960:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.026514:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.034594:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291688960:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.034705:0:82640:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035329:0:82640:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035345:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035358:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035374:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035382:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.035390:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.035406:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291688960/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.035420:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317522.035439:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.035457:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.035465:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317522.035551:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1767317522.035557:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d188 00000080:00010000:0.0:1767317522.035564:0:82640:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.035568:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d188 from it ffffa7f7c0dd3cd8 00010000:00010000:0.0:1767317522.035572:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.035581:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.035681:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:0.0:1767317522.035697:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.035700:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317522.035706:0:82640:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317522.035938:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317522.035942:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287330, osc lock ffff8c3c50c8fb50, flags 0x400000400001002 00010000:00010000:0.0:1767317522.035967:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.036283:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.036299:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317522.036304:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.036322:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.036352:0:82640:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317522.036368:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767317522.036373:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.036377:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.036381:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287330 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.036385:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.036388:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287330 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.036402:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317522.036456:0:82640:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000 00010000:00010000:0.0:1767317522.036492:0:82640:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.036513:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.036562:0:82640:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.036569:0:82640:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.036572:0:82640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d188 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71df1 expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317522.036596:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317522.036671:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9df80 x1853164291689216/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317522.036780:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689216:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317522.037438:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.051937:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689216:192.168.202.133@tcp:36:lfs.0 00000080:00200000:0.0:1767317522.052499:0:82640:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000080:00200000:0.0:1767317522.052508:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767317522.052538:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1767317522.052558:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767317522.052576:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767317522.052581:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287330, osc lock ffff8c3c50c8fb50, flags 0x0 00010000:00010000:0.0:1767317522.052798:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.052939:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.052954:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317522.053282:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689344:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.053491:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.064485:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689344:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.064531:0:82640:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.064550:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.064567:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317522.064600:0:82640:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.064612:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.064621:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317522.064749:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317522.064771:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291689472:192.168.202.133@tcp:10:lfs.0 00000100:00100000:0.0:1767317522.075444:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291689472:192.168.202.133@tcp:10:lfs.0 00000080:00200000:1.0:1767317522.075577:0:82640:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317522.075586:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317522.075590:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317522.075595:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287330 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767317522.075657:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.075675:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767317522.075696:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317522.075700:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287330 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317522.075726:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767317522.075745:0:82640:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000, rc 0 00000080:00200080:1.0:1767317522.075777:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200008:1.0:1767317522.076292:0:82640:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 101f0, mode a7f7, uid 1634659712, gid -29636, new size 18446616789693704712, atime 1767317521.000000000, mtime 1767317521.000000000, ctime 1767317522.000000000 00000020:00100000:1.0:1767317522.076420:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317522.076432:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291689728/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317522.076464:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689728:192.168.202.133@tcp:36:lfs.0 00000100:00100000:1.0:1767317522.076692:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317522.084745:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689728:192.168.202.133@tcp:36:lfs.0 00000080:00200000:1.0:1767317522.085273:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317522.085289:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317522.085293:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317522.085303:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317522.085331:0:82640:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317522.085352:0:82640:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317522.085358:0:82640:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8030, osc lock ffff8c3c60dd0000, flags 0x0 00010000:00010000:1.0:1767317522.085380:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c5075ac00 type 11 mode 2 res 10737419264/161 (0 18446744073709551615) 00010000:00010000:1.0:1767317522.085443:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.085456:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.085468:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317522.085495:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689856:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317522.085600:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:3.0:1767317522.089793:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.089989:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379187840 00000100:00100000:2.0:1767317522.090009:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379187840 00000100:00100000:2.0:1767317522.090080:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9471 00000100:00100000:2.0:1767317522.090092:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:40595:x1853164379187840:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.090113:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.090219:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.090226:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:40595:x1853164379187840:12345-192.168.202.133@tcp:104: Request processed in 137us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.090235:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9471 00010000:00010000:0.0:1767317522.090367:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317522.090376:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.090386:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317522.090393:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317522.090416:0:63742:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317522.090432:0:63742:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767317522.090489:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.090520:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.090562:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.090570:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d17a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dc0 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.090590:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.090592:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.090593:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317522.090602:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317522.090623:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291689984:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317522.095672:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.096008:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379187968 00000100:00100000:2.0:1767317522.096024:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379187968 00000100:00100000:2.0:1767317522.096102:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9472 00000100:00100000:2.0:1767317522.096114:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:41183:x1853164379187968:12345-192.168.202.133@tcp:105: 00010000:00010000:2.0:1767317522.096135:0:56341:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096439:0:56341:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096455:0:56341:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096469:0:56341:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096498:0:56341:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096510:0:56341:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.096535:0:56341:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c3c43af0400) 00000100:00100000:2.0:1767317522.096663:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:41183:x1853164379187968:12345-192.168.202.133@tcp:105: Request processed in 550us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.096671:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9472 00000100:00100000:0.0:1767317522.103078:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291689984:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.103786:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291689856:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317522.104490:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.104517:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317522.104534:0:82640:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.104548:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.104557:0:82640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317522.104690:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291690112:192.168.202.133@tcp:2:lfs.0 00000100:00100000:0.0:1767317522.109700:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291690112:192.168.202.133@tcp:2:lfs.0 00000020:00010000:3.0:1767317522.109774:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.109781:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.109788:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8030 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317522.109811:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.109830:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317522.109853:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.109856:0:82640:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8030 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.109918:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317522.109939:0:82640:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 101f0, mode a7f7, uid 1634659712, gid -29636, new size 18446616789693704712, atime 1767317521.000000000, mtime 1767317521.000000000, ctime 1767317522.000000000, rc 0 00000080:00200080:3.0:1767317522.109961:0:82640:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=ad52a0 00010000:00010000:3.0:1767317522.110066:0:82640:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.110087:0:82640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d165 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71d8f expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317522.110129:0:82640:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317522.110143:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317522.110149:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0000 x1853164291690368/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317522.110179:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690368:192.168.202.133@tcp:35:lfs.0 00000100:00100000:3.0:1767317522.110540:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8180 going to sleep for 11 seconds 00000100:00100000:2.0:1767317522.119621:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.119674:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379188096 00000100:00100000:2.0:1767317522.119688:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379188096 00000100:00100000:2.0:1767317522.119754:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9473 00000100:00100000:2.0:1767317522.119766:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379188096:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.119789:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.119919:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.119927:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379188096:12345-192.168.202.133@tcp:104: Request processed in 163us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.119935:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9473 00010000:00010000:1.0:1767317522.120342:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317522.120353:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120364:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317522.120370:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120379:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120388:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317522.120445:0:63276:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317522.120494:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120501:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317522.120530:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120538:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d16c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71dab expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.120553:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.120555:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.120557:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317522.120576:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291690496:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.125853:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291690496:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317522.135861:0:82640:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937289 gen 1 00000100:00100000:3.0:1767317522.135941:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690368:192.168.202.133@tcp:35:lfs.0 00000002:00100000:3.0:1767317522.136418:0:82640:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0a80 x1853164291686656/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767317522.136554:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:3.0:1767317522.136572:0:82640:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:3.0:1767317522.136587:0:82640:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:3.0:1767317522.136656:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82640 initiator: MDT0 00010000:00010000:3.0:1767317522.136667:0:82640:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00010000:00010000:3.0:1767317522.136679:0:82640:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82640 initiator: MDT0 00000100:00100000:3.0:1767317522.136707:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690624:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.136929:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8180 going to sleep for 12 seconds 00000100:00100000:3.0:1767317522.152795:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690624:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317522.153367:0:82640:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.153384:0:82640:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767317522.153545:0:82640:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c58fc0000 x1853164291690624/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317522.153558:0:82640:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767317522.153685:0:82640:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.153703:0:82640:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767317522.153730:0:82640:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317522.153752:0:82640:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d19d 00000080:00010000:2.0:1767317522.153762:0:82640:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d19d from it ffffa7f7c0dd3bc8 00010000:00010000:2.0:1767317522.153767:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.153777:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.153918:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.153932:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317522.153941:0:82640:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.154755:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.154772:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317522.154797:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767317522.155731:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317522.155735:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317522.155743:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317522.155785:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1767317522.155932:0:82640:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.156281:0:82640:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317522.156295:0:82640:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317522.156346:0:82640:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767317522.156352:0:82640:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317522.156355:0:82640:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317522.156358:0:82640:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317522.156370:0:82640:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1767317522.156550:0:82640:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317521 1767317521 0 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317521 1767317521 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317522.156592:0:82640:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317521 1767317521 0 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317522 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317522.156610:0:82640:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317521 1767317521 0 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317522 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317522.156683:0:82640:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:2.0:1767317522.156690:0:82640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.156700:0:82640:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317522.156765:0:82640:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154002 00000002:00100000:2.0:1767317522.157412:0:82640:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317522.157426:0:82640:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317522.157503:0:82640:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38e00 x1853164291690880/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317522.157533:0:82640:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690880:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317522.157706:0:82640:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317522.163675:0:82640:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82640:1853164291690880:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317522.163738:0:82640:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9ca80 x1853164291686016/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317538 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317522.184688:0:82642:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317522.184730:0:82642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317522.184753:0:82642:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.184773:0:82642:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317522.184795:0:82642:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317522.184979:0:82642:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317522.184985:0:82642:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:1.0:1767317522.185225:0:82642:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483bf8 00010000:00010000:1.0:1767317522.185233:0:82642:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.185244:0:82642:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317522.185266:0:82642:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317522.185286:0:82642:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c61b5a480, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1767317522.185294:0:82642:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:1.0:1767317522.185326:0:82642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:1.0:1767317522.185402:0:82642:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82642 initiator: MDT0 00010000:00010000:1.0:1767317522.185409:0:82642:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82642 initiator: MDT0 00000020:00100000:1.0:1767317522.185423:0:82642:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317522.185542:0:82642:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291691136/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317522.185554:0:82642:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82642 initiator: MDT0 00000100:00100000:1.0:1767317522.185581:0:82642:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82642:1853164291691136:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317522.187617:0:82642:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.193896:0:82642:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82642:1853164291691136:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.193929:0:82642:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.193944:0:82642:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.193951:0:82642:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.193979:0:82642:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.193989:0:82642:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.193995:0:82642:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317522.194001:0:82642:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.194009:0:82642:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.194017:0:82642:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.194025:0:82642:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317522.194033:0:82642:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82642 initiator: MDT0 00010000:00010000:0.0:1767317522.194039:0:82642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d1a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82642 initiator: MDT0 00000002:00100000:0.0:1767317522.194061:0:82642:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c437c3100 x1853164291691136/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317522.194078:0:82642:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767317522.194248:0:82642:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317522.194293:0:82642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.194309:0:82642:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.194359:0:82642:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.194368:0:82642:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.194375:0:82642:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317522.194380:0:82642:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317522.194386:0:82642:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483bb0 00010000:00010000:0.0:1767317522.194390:0:82642:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.194397:0:82642:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.194415:0:82642:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317522.194428:0:82642:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:0.0:1767317522.194474:0:82642:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=11a13d0 00000100:00100000:0.0:1767317522.194561:0:82642:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82642:1853164291691264:192.168.202.133@tcp:34:lfs.0 00000100:00100000:0.0:1767317522.195016:0:82642:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.203860:0:82642:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82642:1853164291691264:192.168.202.133@tcp:34:lfs.0 00000080:00200008:0.0:1767317522.207999:0:82642:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:0.0:1767317522.239092:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317522.239135:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.239158:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.239176:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.239193:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.239203:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317522.239208:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317522.239217:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c6fb58 00010000:00010000:0.0:1767317522.239222:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.239232:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.239251:0:82644:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317522.239266:0:82644:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:0.0:1767317522.239270:0:82644:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317522.239285:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.239357:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82644 initiator: MDT0 00010000:00010000:0.0:1767317522.239365:0:82644:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82644 initiator: MDT0 00010000:00010000:0.0:1767317522.239376:0:82644:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82644 initiator: MDT0 00000100:00100000:0.0:1767317522.239409:0:82644:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691392:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.239582:0:82644:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.244688:0:82644:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691392:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.244730:0:82644:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244771:0:82644:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244780:0:82644:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244793:0:82644:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244813:0:82644:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244827:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244835:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.244843:0:82644:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.244854:0:82644:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9dc00 x1853164291691392/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.244866:0:82644:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317522.244907:0:82644:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.244929:0:82644:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.244937:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317522.245000:0:82644:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767317522.245004:0:82644:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:0.0:1767317522.245020:0:82644:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:0.0:1767317522.245025:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:0.0:1767317522.245038:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.245042:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fb20 00010000:00010000:0.0:1767317522.245046:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.245054:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317522.245105:0:82644:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.245112:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.245141:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.245150:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.245161:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.245168:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.245173:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.245176:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:0.0:1767317522.245180:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fcb8 00010000:00010000:0.0:1767317522.245189:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.245196:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.245262:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317522.245271:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.245279:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.245287:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.245292:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.245297:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317522.245299:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317522.245302:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c6fbf8 00010000:00010000:0.0:1767317522.245305:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.245325:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.245334:0:82644:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317522.245342:0:82644:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767317522.245348:0:82644:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 44 00000080:00200008:0.0:1767317522.245358:0:82644:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154400 00000002:00010000:0.0:1767317522.245375:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767317522.245435:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82644 initiator: MDT0 00010000:00010000:0.0:1767317522.245441:0:82644:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82644 initiator: MDT0 00000020:00100000:0.0:1767317522.245454:0:82644:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317522.245461:0:82644:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291691648/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317522.245470:0:82644:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82644 initiator: MDT0 00000100:00100000:0.0:1767317522.245493:0:82644:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691648:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.245733:0:82644:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.248783:0:82644:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691648:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.248825:0:82644:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.248838:0:82644:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.248853:0:82644:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.248866:0:82644:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.248905:0:82644:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9dc00 x1853164291691648/t8589937291(8589937291) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317522.248939:0:82644:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291691648/t8589937291(8589937291) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.248954:0:82644:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317522.248968:0:82644:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.248980:0:82644:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.248988:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317522.249048:0:82644:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767317522.249064:0:82644:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:0.0:1767317522.249070:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1b2 00000080:00010000:0.0:1767317522.249077:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1b2 from it ffffa7f7c1c6fbf0 00010000:00010000:0.0:1767317522.249082:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.249103:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317522.249142:0:82644:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291691648/t8589937291(8589937291) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1767317522.249289:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7ffd22d6da64 00000002:00010000:0.0:1767317522.249327:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:0.0:1767317522.249390:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82644 initiator: MDT0 00010000:00010000:0.0:1767317522.249407:0:82644:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82644 initiator: MDT0 00000020:00100000:0.0:1767317522.249420:0:82644:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317522.249426:0:82644:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9fb80 x1853164291691904/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317522.249435:0:82644:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82644 initiator: MDT0 00000100:00100000:0.0:1767317522.249460:0:82644:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691904:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.249692:0:82644:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.256910:0:82644:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291691904:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.256946:0:82644:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.256960:0:82644:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.256977:0:82644:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.256991:0:82644:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.257005:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.257014:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.257040:0:82644:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.257054:0:82644:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c50e9fb80 x1853164291691904/t8589937292(8589937292) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317522.257068:0:82644:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9fb80 x1853164291691904/t8589937292(8589937292) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.257087:0:82644:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.257105:0:82644:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.257113:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317522.257139:0:82644:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9fb80 x1853164291691904/t8589937292(8589937292) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317522.257148:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1b9 00000080:00010000:0.0:1767317522.257156:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1b9 from it ffffa7f7c1c6fcc0 00010000:00010000:0.0:1767317522.257159:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.257166:0:82644:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.257444:0:82644:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317522.257456:0:82644:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:0.0:1767317522.257494:0:82644:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.257508:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.257535:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.257545:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.257557:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.257565:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.257571:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.257576:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:0.0:1767317522.257580:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fcd8 00010000:00010000:0.0:1767317522.257583:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.257591:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317522.257670:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=1 00010000:00010000:2.0:1767317522.273047:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:3.0:1767317522.338650:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317522.338683:0:82644:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317522.338696:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317522.338820:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.338851:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.338900:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317522.338911:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317522.338927:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317522.338932:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:3.0:1767317522.338941:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fcd8 00010000:00010000:3.0:1767317522.338946:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.338969:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317522.339839:0:82644:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767317522.339861:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1767317522.340102:0:82644:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317522.340107:0:82644:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317522.340126:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317522.340138:0:82644:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767317522.340154:0:82644:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317522.340164:0:82644:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317522.340167:0:82644:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767317522.340169:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:3.0:1767317522.340179:0:82644:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317522.340189:0:82644:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317522.340194:0:82644:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317522.340218:0:82644:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317522.340238:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317522.340243:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec1b0, osc lock ffff8c3c60cb50a0, flags 0x40000 00000080:00200000:3.0:1767317522.340254:0:82644:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:3.0:1767317522.340262:0:82644:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317522.340268:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317522.340271:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412eccb0, osc lock ffff8c3c60cb5c80, flags 0x400001002 00010000:00010000:3.0:1767317522.340294:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.340324:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317522.340369:0:82644:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.340383:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317522.340389:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.340400:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.340420:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317522.340430:0:82644:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767317522.340434:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.340438:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.340442:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412eccb0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.340447:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.340450:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412eccb0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.340470:0:82644:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317522.340479:0:82644:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317522.340541:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317522.340544:0:82644:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317522.340550:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.340553:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.340555:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec1b0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.340558:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.340561:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec1b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.340571:0:82644:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317522.340577:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317522.342136:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bac00 00000008:00100000:3.0:1767317522.342214:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc3b80 - object 0x280000400:161 offset 0<>29 00000100:00100000:3.0:1767317522.342293:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291692032:192.168.202.133@tcp:3:lfs.0 00000100:00100000:3.0:1767317522.353165:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.353479:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379188608 00000100:00100000:2.0:1767317522.353500:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379188608 00000100:00100000:2.0:1767317522.353633:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9474 00000100:00100000:2.0:1767317522.353647:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379188608:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.353672:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.353796:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.353804:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379188608:12345-192.168.202.133@tcp:104: Request processed in 161us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.353812:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9474 00010000:00010000:0.0:1767317522.353927:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317522.353937:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.353946:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317522.353954:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400020000 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317522.353981:0:60279:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767317522.354028:0:60279:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767317522.354082:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.354100:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.354124:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.354131:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d196 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x541306ba06a71e0d expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.354159:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.354161:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.354163:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317522.354535:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291692160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.359779:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291692160:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:2.0:1767317522.360183:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bac00 00000020:00200000:2.0:1767317522.360191:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317522.360200:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767317522.360211:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317522.360392:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317522.360414:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bac00 00000100:00100000:3.0:1767317522.360444:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291692032:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317522.360530:0:82644:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317522.360549:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317522.360576:0:82644:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317522.360579:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317522.360589:0:82644:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317522.360674:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317522.360737:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:2.0:1767317522.360746:0:82644:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317522.360755:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317522.360791:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317522.360816:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.360833:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317522.360842:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317522.360851:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317522.360855:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:2.0:1767317522.360863:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fcd8 00010000:00010000:2.0:1767317522.360867:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.361090:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317522.361130:0:82644:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317522.361140:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00020000:00200000:2.0:1767317522.361156:0:82644:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317522.361159:0:82644:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317522.361182:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317522.361192:0:82644:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317522.361208:0:82644:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767317522.361218:0:82644:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317522.361221:0:82644:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317522.361223:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:2.0:1767317522.361235:0:82644:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317522.361677:0:82644:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317522.361685:0:82644:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767317522.361795:0:82644:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317522.361820:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317522.361825:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511792b0, osc lock ffff8c3c61004d10, flags 0x40000 00000080:00200000:2.0:1767317522.361835:0:82644:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767317522.361846:0:82644:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317522.361853:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317522.361855:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179130, osc lock ffff8c3c61004720, flags 0x400001002 00010000:00010000:2.0:1767317522.362283:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.362407:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317522.362428:0:82644:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.362440:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317522.362444:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.362454:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.362473:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317522.362484:0:82644:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317522.362489:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.362492:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.362496:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179130 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.362516:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.362519:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179130 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.362537:0:82644:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317522.362545:0:82644:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317522.362657:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317522.362661:0:82644:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317522.362670:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317522.362673:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.362675:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511792b0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317522.362678:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317522.362680:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511792b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317522.362688:0:82644:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317522.362695:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317522.362725:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bac00 00000008:00100000:3.0:1767317522.362787:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc3b80 - object 0x2c0000400:193 offset 0<>29 00000100:00100000:2.0:1767317522.362900:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291692288:192.168.202.133@tcp:3:lfs.0 00000100:00100000:3.0:1767317522.372161:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.372266:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317522.372305:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379188736 00000100:00100000:2.0:1767317522.372326:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379188736 00000100:00100000:2.0:1767317522.372404:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9475 00000100:00100000:2.0:1767317522.372415:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379188736:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.372446:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.372547:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.372555:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379188736:12345-192.168.202.133@tcp:104: Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.372579:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9475 00010000:00010000:1.0:1767317522.372983:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317522.372993:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.373004:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317522.373010:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317522.373039:0:64002:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317522.373056:0:64002:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317522.373125:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.373133:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317522.373173:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.373183:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d181 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71de3 expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.373211:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.373213:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.373215:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317522.373234:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317522.373256:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291692416:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:3.0:1767317522.379576:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bac00 00000020:00200000:3.0:1767317522.379593:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317522.379603:0:2520:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317522.379615:0:2520:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317522.379633:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317522.379727:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bac00 00000100:00100000:3.0:1767317522.379761:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291692288:192.168.202.133@tcp:3:lfs.0 00000080:00200000:0.0:1767317522.384045:0:82644:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317522.384078:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317522.384084:0:82644:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767317522.384091:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317522.384105:0:82644:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767317522.384129:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317522.384145:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:0.0:1767317522.384153:0:82644:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.384163:0:82644:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.384202:0:82644:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.384225:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.384243:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.384269:0:82644:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.384289:0:82644:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.384294:0:82644:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ab 00000080:00010000:0.0:1767317522.384303:0:82644:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ab from it ffffa7f7c1c6fcd8 00010000:00010000:0.0:1767317522.384307:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.384323:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317522.384356:0:82644:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:0.0:1767317522.384366:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00020000:00200000:0.0:1767317522.384378:0:82644:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.384381:0:82644:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767317522.384393:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317522.384400:0:82644:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767317522.384410:0:82644:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:0.0:1767317522.384418:0:82644:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767317522.384421:0:82644:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767317522.384423:0:82644:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:0.0:1767317522.384637:0:82644:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767317522.384646:0:82644:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767317522.384650:0:82644:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317522.384669:0:82644:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767317522.384690:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767317522.384695:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287a30, osc lock ffff8c3c50c8ebe0, flags 0x40000 00000080:00200000:0.0:1767317522.384704:0:82644:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:0.0:1767317522.384719:0:82644:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317522.384724:0:82644:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317522.384732:0:82644:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287ab0, osc lock ffff8c3c50c8fc80, flags 0x400001002 00000100:00100000:1.0:1767317522.384748:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291692416:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317522.384749:0:82644:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.384766:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317522.384781:0:82644:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.384792:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317522.384796:0:82644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.384803:0:82644:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.384814:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317522.384821:0:82644:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 24 00000020:00010000:0.0:1767317522.384824:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.384828:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.384831:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287ab0 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.384835:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.384837:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287ab0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.384848:0:82644:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767317522.384855:0:82644:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767317522.384929:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767317522.384932:0:82644:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767317522.384943:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.384946:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.384949:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287a30 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.384951:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.384954:0:82644:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287a30 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.384960:0:82644:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767317522.384964:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317522.384986:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e8600 00000008:00100000:0.0:1767317522.385035:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9d880 - object 0x280000400:162 offset 0<>29 00000100:00100000:0.0:1767317522.385134:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317522.385148:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291692544:192.168.202.133@tcp:3:lfs.0 00000100:00100000:3.0:1767317522.393481:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.394550:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379188864 00000100:00100000:2.0:1767317522.394568:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379188864 00000100:00100000:2.0:1767317522.394650:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9476 00000100:00100000:2.0:1767317522.394662:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36300:x1853164379188864:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.394687:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.394818:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.394826:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36300:x1853164379188864:12345-192.168.202.133@tcp:104: Request processed in 166us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.394834:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9476 00010000:00010000:1.0:1767317522.395238:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317522.395257:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.395269:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317522.395281:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317522.395349:0:63743:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317522.395367:0:63743:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317522.395426:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.395434:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317522.395472:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.395481:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d18f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71dff expref: -99 pid: 82640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.395509:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.395512:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.395514:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317522.395532:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291692672:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317522.404594:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291692672:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:0.0:1767317522.415155:0:2517:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e8600 00000020:00200000:0.0:1767317522.415171:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317522.415183:0:2517:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:0.0:1767317522.415196:0:2517:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767317522.415218:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317522.415236:0:2517:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e8600 00000100:00100000:0.0:1767317522.415267:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291692544:192.168.202.133@tcp:3:lfs.0 00000080:00200000:3.0:1767317522.416620:0:82644:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317522.416646:0:82644:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317522.416653:0:82644:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767317522.416658:0:82644:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317522.416671:0:82644:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767317522.416717:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317522.447753:0:82644:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7ffd22d6da74 00010000:00010000:2.0:1767317522.447793:0:82644:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317522.447867:0:82644:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317522.447901:0:82644:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1767317522.447935:0:82644:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291692800:192.168.202.133@tcp:103:lfs.0 00000100:00100000:2.0:1767317522.448078:0:82644:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.451476:0:82644:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291692800:192.168.202.133@tcp:103:lfs.0 00010000:00010000:0.0:1767317522.451512:0:82644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1b9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71e84 expref: -99 pid: 82644 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.451596:0:82644:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9fb80 x1853164291691904/t8589937292(8589937292) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317522.451648:0:82644:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317522.451655:0:82644:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d880 x1853164291693056/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317522.451685:0:82644:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291693056:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317522.451806:0:82644:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.459757:0:82644:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82644:1853164291693056:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317522.459810:0:82644:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9fb80 x1853164291691904/t8589937292(8589937292) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317522.459918:0:82644:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154000 00010000:00010000:0.0:1767317522.459956:0:82644:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.489039:0:82645:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317522.489089:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.489118:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.489142:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.489153:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.489165:0:82645:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317522.489171:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317522.489183:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0c87bf8 00010000:00010000:0.0:1767317522.489189:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.489208:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.489234:0:82645:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317522.489246:0:82645:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767317522.489252:0:82645:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 42 00000080:00200008:0.0:1767317522.489260:0:82645:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 140001 00000002:00010000:0.0:1767317522.489283:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100002 00010000:00010000:0.0:1767317522.497790:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.497817:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000020:00100000:0.0:1767317522.497836:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317522.497853:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d880 x1853164291693312/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317522.497864:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000100:00100000:0.0:1767317522.497916:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693312:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.498208:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b9c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317522.502662:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317522.504703:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379188992 00000100:00100000:3.0:1767317522.504727:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379188992 00000100:00100000:3.0:1767317522.504827:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9477 00000100:00100000:3.0:1767317522.504840:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379188992:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317522.504866:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.505103:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.505113:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379188992:12345-192.168.202.133@tcp:104: Request processed in 275us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.505122:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9477 00010000:00010000:1.0:1767317522.505332:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317522.505348:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505358:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317522.505364:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505375:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505385:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505421:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505478:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505486:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317522.505520:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505528:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d1ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71e61 expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.505546:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.505548:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.505549:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317522.505594:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317522.505615:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291693440:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317522.513934:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291693440:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.517650:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693312:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317522.518273:0:82645:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518296:0:82645:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518306:0:82645:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518329:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518342:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518358:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518366:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518373:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317522.518387:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317522.518400:0:82645:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317522.518419:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518442:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317522.518450:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317522.518522:0:82645:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:1.0:1767317522.518529:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1c0 00000080:00010000:1.0:1767317522.518539:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1c0 from it ffffa7f7c0c87bf0 00010000:00010000:1.0:1767317522.518543:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.518551:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317522.518585:0:82645:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317522.520274:0:82645:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317522.520292:0:82645:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:1.0:1767317522.520345:0:82645:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317522.520355:0:82645:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:1.0:1767317522.520384:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317522.520401:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767317522.520469:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:1.0:1767317522.520478:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00010000:00010000:1.0:1767317522.520491:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000100:00100000:1.0:1767317522.520536:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693568:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317522.520670:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907240 going to sleep for 12 seconds 00000100:00100000:3.0:1767317522.527193:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317522.527665:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379189120 00000100:00100000:2.0:1767317522.527680:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379189120 00000100:00100000:2.0:1767317522.527755:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9478 00000100:00100000:2.0:1767317522.527768:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379189120:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317522.527792:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317522.527947:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317522.527956:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379189120:12345-192.168.202.133@tcp:104: Request processed in 190us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317522.527964:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9478 00010000:00010000:0.0:1767317522.528131:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317522.528157:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528168:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58cccc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317522.528175:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528185:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528195:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528232:0:50308:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.528279:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528286:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.528335:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528343:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1c0 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71eae expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.528360:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.528362:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317522.528364:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317522.528374:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317522.528411:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291693696:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317522.541235:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291693696:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.543500:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693568:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317522.543535:0:82645:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543551:0:82645:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543564:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543576:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543590:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543598:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317522.543607:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317522.543738:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291693568/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317522.543751:0:82645:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317522.543786:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.543803:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317522.543811:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317522.543899:0:82645:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767317522.543918:0:82645:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:1.0:1767317522.543924:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1c7 00000080:00010000:1.0:1767317522.543930:0:82645:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317522.543933:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1c7 from it ffffa7f7c0c87cd8 00010000:00010000:1.0:1767317522.543937:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.543945:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200080:2.0:1767317522.665249:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffa3db77c0 00000002:00010000:2.0:1767317522.665317:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1767317522.665346:0:82645:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.665379:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767317522.665444:0:82645:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9dc00 x1853164291691648/t8589937291(8589937291) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317522.665459:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317522.665465:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38e00 x1853164291693952/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317522.665494:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693952:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317522.666513:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.682940:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291693952:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317522.683149:0:82645:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9dc00 x1853164291691648/t8589937291(8589937291) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317522.683203:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.683278:0:82645:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.683287:0:82645:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.683290:0:82645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71e6f expref: -99 pid: 82644 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.683337:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.683345:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000020:00100000:0.0:1767317522.683358:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317522.683364:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291694208/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317522.683374:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82645 initiator: MDT0 00000100:00100000:0.0:1767317522.683399:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694208:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.684296:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.689685:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694208:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.689729:0:82645:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689745:0:82645:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689761:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689774:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689789:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689798:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689806:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.689817:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317522.689831:0:82645:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.689849:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.689931:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.689940:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317522.689965:0:82645:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317522.689981:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ce 00000080:00010000:0.0:1767317522.689989:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ce from it ffffa7f7c0c87cc0 00010000:00010000:0.0:1767317522.689993:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.690000:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.690360:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1767317522.690376:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.690380:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317522.690387:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000100:00100000:1.0:1767317522.690543:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291694336:192.168.202.133@tcp:1:lfs.0 00000100:00100000:1.0:1767317522.698375:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291694336:192.168.202.133@tcp:1:lfs.0 00010000:00010000:0.0:1767317522.698686:0:82645:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.698822:0:82645:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317522.698845:0:82645:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.698856:0:82645:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317522.698956:0:82645:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.698962:0:82645:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.699159:0:82645:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317522.699162:0:82645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d19d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71e1b expref: -99 pid: 82640 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.699178:0:82645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d1c7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71ec3 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317522.699198:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317522.699210:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291694592/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317522.699241:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694592:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317522.699435:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.713066:0:82645:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937297 gen 1 00000100:00100000:0.0:1767317522.713094:0:82645:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317522.713108:0:82645:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317522.713120:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694592:192.168.202.133@tcp:36:lfs.0 00010000:00010000:0.0:1767317522.713186:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:0.0:1767317522.713202:0:82645:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:0.0:1767317522.713216:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317522.713288:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.713298:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.713340:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000100:00100000:0.0:1767317522.713365:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694720:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.713471:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.727070:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694720:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.727113:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727133:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317522.727149:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9e300 x1853164291694720/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.727162:0:82645:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317522.727177:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727195:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.727203:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317522.727225:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1d5 00000080:00010000:0.0:1767317522.727236:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1d5 from it ffffa7f7c0c87c70 00010000:00010000:0.0:1767317522.727241:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727269:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727301:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727326:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317522.727335:0:82645:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727385:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727393:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.727411:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317522.727424:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.727428:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317522.727436:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317522.727472:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317522.727486:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727496:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317522.727516:0:82645:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.727535:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317522.727540:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.727544:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317522.727546:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317522.727555:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317522.727644:0:82645:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 7 00010000:00010000:0.0:1767317522.727650:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.727659:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317522.727690:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=7fffa3db77c0 00000080:00200080:0.0:1767317522.727743:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:0.0:1767317522.727753:0:82645:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.727763:0:82645:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.727781:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.727791:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767317522.727847:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.727856:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.727867:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000100:00100000:0.0:1767317522.727990:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694848:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.728102:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.739672:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291694848:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.740363:0:82645:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740381:0:82645:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740395:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740408:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740424:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740433:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.740441:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.740456:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e300 x1853164291694848/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.740468:0:82645:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317522.740508:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.740526:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.740533:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317522.740603:0:82645:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 7 -> 7 00000080:00010000:0.0:1767317522.740619:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1dc 00000080:00010000:0.0:1767317522.740626:0:82645:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.740629:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1dc from it ffffa7f7c0c87cd8 00010000:00010000:0.0:1767317522.740632:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.740642:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.740684:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 6 restore needed 0 00020000:00200000:0.0:1767317522.740698:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.740701:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317522.741378:0:82645:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317522.741407:0:82645:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317522.741411:0:82645:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287ab0, osc lock ffff8c3c50c8ebe0, flags 0x400000400001002 00010000:00010000:0.0:1767317522.741482:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.741493:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.741508:0:82645:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9e300 x1853164291694976/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317522.741621:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291694976:192.168.202.133@tcp:101:lfs.0 00000020:00200000:0.0:1767317522.742417:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317522.747533:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747570:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747628:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747644:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317522.747666:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317522.747678:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317522.747697:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747713:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747720:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317522.747729:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317522.747752:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291694976:192.168.202.133@tcp:101:lfs.0 00000080:00200000:0.0:1767317522.747935:0:82645:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767317522.747944:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.747947:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.747953:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287ab0 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.747960:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.747963:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287ab0 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.747988:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317522.748041:0:82645:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1767317522.748052:0:82645:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:0.0:1767317522.748066:0:82645:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767317522.748074:0:82645:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767317522.748076:0:82645:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:0.0:1767317522.748081:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 restore needed 0 00000080:00200000:0.0:1767317522.748099:0:82645:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767317522.748108:0:82645:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1767317522.748113:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317522.748136:0:82645:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1767317522.748151:0:82645:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:0.0:1767317522.748156:0:82645:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287ab0, osc lock ffff8c3c50c8ebe0, flags 0x0 00000080:00200000:0.0:1767317522.748166:0:82645:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:0.0:1767317522.748199:0:82645:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:0.0:1767317522.748261:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767317522.748264:0:82645:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:0.0:1767317522.748273:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.748277:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.748279:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287ab0 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.748282:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.748294:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287ab0 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.748300:0:82645:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1767317522.748317:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317522.748339:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e8600 00000008:00100000:0.0:1767317522.748447:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9c380 - object 0x2c0000400:193 offset 0<>4096 00000100:00100000:1.0:1767317522.749146:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291695104:192.168.202.133@tcp:4:lfs.0 00000100:00100000:1.0:1767317522.759206:0:2518:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805055 gen 3 00000008:00010000:1.0:1767317522.759271:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e8600 00000020:00200000:1.0:1767317522.759280:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767317522.759292:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767317522.759323:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e8600 00000100:00100000:1.0:1767317522.759358:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291695104:192.168.202.133@tcp:4:lfs.0 00000080:00200000:0.0:1767317522.759567:0:82645:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317522.759586:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317522.759592:0:82645:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:0.0:1767317522.759612:0:82645:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 4096 i_blocks 16 00000020:00200000:0.0:1767317522.759616:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317522.759626:0:82645:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:0.0:1767317522.759653:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317522.759662:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=0 00000080:00200080:0.0:1767317522.759682:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:0.0:1767317522.759691:0:82645:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.759700:0:82645:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.759728:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.759752:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.759780:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.759790:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.759806:0:82645:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.759811:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1dc 00000080:00010000:0.0:1767317522.759819:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1dc from it ffffa7f7c0c87cd8 00010000:00010000:0.0:1767317522.759824:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.759857:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.759909:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 restore needed 0 00020000:00200000:0.0:1767317522.759923:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.759926:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317522.759932:0:82645:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317522.759954:0:82645:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317522.759960:0:82645:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287ab0, osc lock ffff8c3c50c8ebe0, flags 0x400000400001002 00010000:00010000:0.0:1767317522.759979:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.759990:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.760001:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317522.760005:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.762940:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317522.762969:0:82645:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317522.762993:0:82645:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 4096 i_blocks 16 00000020:00010000:0.0:1767317522.762999:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.763003:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.763017:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287ab0 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.763049:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eadda8 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.763053:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287ab0 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.763073:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317522.763135:0:82645:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 4096, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 23, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000 00010000:00010000:0.0:1767317522.763197:0:82645:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.763225:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.763281:0:82645:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.763287:0:82645:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317522.763291:0:82645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1dc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71efb expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317522.763471:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317522.763488:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d500 x1853164291695360/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317522.763519:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695360:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317522.763655:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.769463:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695360:192.168.202.133@tcp:36:lfs.0 00000080:00200000:0.0:1767317522.769517:0:82645:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:0.0:1767317522.769523:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 restore needed 0 00020000:00200000:0.0:1767317522.769545:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317522.769561:0:82645:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767317522.769590:0:82645:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767317522.769594:0:82645:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287ab0, osc lock ffff8c3c50c8ebe0, flags 0x0 00010000:00010000:0.0:1767317522.769670:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.769680:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.769689:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317522.769708:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695488:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.770003:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.772466:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695488:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.772502:0:82645:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.772516:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.772529:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317522.772542:0:82645:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.772551:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.772572:0:82645:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317522.772697:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291695616:192.168.202.133@tcp:10:lfs.0 00000100:00100000:1.0:1767317522.775470:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291695616:192.168.202.133@tcp:10:lfs.0 00000080:00200000:0.0:1767317522.775569:0:82645:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:0.0:1767317522.775576:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.775580:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.775585:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287ab0 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767317522.775595:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317522.775607:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767317522.775626:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61c68 (ffff8c3c5a084ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.775629:0:82645:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287ab0 (ffff8c3c5a084ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.775651:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317522.775666:0:82645:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 23, atime 1767317522.000000000, mtime 1767317522.000000000, ctime 1767317522.000000000, rc 0 00000080:00200080:0.0:1767317522.775688:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317522.775695:0:82645:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffa3db77c0 00010000:00010000:0.0:1767317522.775758:0:82645:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.776591:0:82645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1ce lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a71ed1 expref: -99 pid: 82645 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.776667:0:82645:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317522.776681:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317522.776687:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291695872/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317522.776717:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695872:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317522.776835:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1767317522.780500:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317522.782395:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379189632 00000100:00100000:3.0:1767317522.782413:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379189632 00000100:00100000:3.0:1767317522.782493:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9479 00000100:00100000:3.0:1767317522.782504:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379189632:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317522.782523:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.782631:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317522.782638:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:31215:x1853164379189632:12345-192.168.202.133@tcp:104: Request processed in 136us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317522.782646:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9479 00010000:00010000:1.0:1767317522.783926:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317522.783940:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.783952:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317522.783958:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.783967:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.783978:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317522.784021:0:42098:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317522.784087:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.784095:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317522.784158:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.784166:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d1d5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71eed expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317522.784187:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.784189:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317522.784192:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317522.784203:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317522.784972:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291696000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317522.789263:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291696000:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317522.800145:0:82645:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937300 gen 1 00000100:00100000:0.0:1767317522.800197:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291695872:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317522.800238:0:82645:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9dc00 x1853164291694208/t8589937296(8589937296) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317522.800279:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:0.0:1767317522.800293:0:82645:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:0.0:1767317522.800316:0:82645:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317522.800379:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.800389:0:82645:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00010000:00010000:0.0:1767317522.800399:0:82645:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82645 initiator: MDT0 00000100:00100000:0.0:1767317522.800423:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291696128:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317522.800522:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.807758:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291696128:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.807809:0:82645:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.807826:0:82645:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317522.807843:0:82645:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9c380 x1853164291696128/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.807854:0:82645:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317522.807915:0:82645:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.807933:0:82645:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.807941:0:82645:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317522.807961:0:82645:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f1 00000080:00010000:0.0:1767317522.807980:0:82645:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f1 from it ffffa7f7c0c87bc8 00010000:00010000:0.0:1767317522.807985:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.807995:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.808025:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.808038:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317522.808077:0:82645:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.808125:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.808133:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.808149:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317522.808160:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.808164:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317522.808181:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317522.808724:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317522.808744:0:82645:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.808759:0:82645:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317522.808768:0:82645:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.808806:0:82645:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317522.808812:0:82645:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317522.808814:0:82645:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317522.808817:0:82645:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317522.808827:0:82645:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1767317522.808927:0:82645:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317522 1767317522 0 by oinfo size 23 blocks 8 [cma]time 1767317522 1767317522 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317522.808947:0:82645:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317522 1767317522 0 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317522 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317522.809337:0:82645:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 8 00010000:00010000:0.0:1767317522.809344:0:82645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.809353:0:82645:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317522.823742:0:82645:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 140001 00000002:00100000:0.0:1767317522.823854:0:82645:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317522.824076:0:82645:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317522.824085:0:82645:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291696384/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317522.824119:0:82645:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291696384:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317522.824291:0:82645:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1767317522.827094:0:82645:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82645:1853164291696384:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317522.827143:0:82645:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9d880 x1853164291693312/t8589937294(8589937294) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317522.837337:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317522.837380:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.837401:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.837419:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317522.837427:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317522.837443:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317522.837447:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:3.0:1767317522.837456:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1dafb58 00010000:00010000:3.0:1767317522.837460:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.837468:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317522.837487:0:82646:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317522.837503:0:82646:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:3.0:1767317522.837507:0:82646:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317522.837523:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.837582:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82646 initiator: MDT0 00010000:00010000:3.0:1767317522.837590:0:82646:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82646 initiator: MDT0 00010000:00010000:3.0:1767317522.837600:0:82646:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82646 initiator: MDT0 00000100:00100000:3.0:1767317522.837632:0:82646:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291696512:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.837819:0:82646:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8780 going to sleep for 12 seconds 00000100:00100000:3.0:1767317522.853139:0:82646:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291696512:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317522.853360:0:82646:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853381:0:82646:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853411:0:82646:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853424:0:82646:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853437:0:82646:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853451:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853460:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.853468:0:82646:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317522.853492:0:82646:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc0700 x1853164291696512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317522.853505:0:82646:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317522.853522:0:82646:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.853533:0:82646:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767317522.853541:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317522.853606:0:82646:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:3.0:1767317522.853610:0:82646:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:3.0:1767317522.855587:0:82646:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:3.0:1767317522.855601:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:3.0:1767317522.855618:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317522.855622:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafb20 00010000:00010000:3.0:1767317522.855629:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.855642:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317522.855696:0:82646:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317522.855704:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317522.855733:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.855747:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.855759:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317522.855767:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317522.855771:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317522.855775:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:3.0:1767317522.855779:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafcb8 00010000:00010000:3.0:1767317522.855781:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.855789:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317522.856354:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317522.856365:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317522.856374:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.856382:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317522.856389:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317522.856394:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317522.856397:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:3.0:1767317522.856401:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1dafbf8 00010000:00010000:3.0:1767317522.856404:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.856412:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317522.856420:0:82646:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317522.856428:0:82646:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:3.0:1767317522.856435:0:82646:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 44 00000080:00200008:3.0:1767317522.856445:0:82646:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154400 00000002:00010000:3.0:1767317522.856463:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1767317522.856538:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82646 initiator: MDT0 00010000:00010000:3.0:1767317522.856546:0:82646:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82646 initiator: MDT0 00000020:00100000:3.0:1767317522.856572:0:82646:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317522.856587:0:82646:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0700 x1853164291696768/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317522.856597:0:82646:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82646 initiator: MDT0 00000100:00100000:3.0:1767317522.856624:0:82646:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291696768:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.857475:0:82646:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8780 going to sleep for 12 seconds 00000100:00100000:3.0:1767317522.867249:0:82646:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291696768:192.168.202.133@tcp:101:lfs.0 00010000:00010000:3.0:1767317522.867290:0:82646:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.867303:0:82646:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.867328:0:82646:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317522.867339:0:82646:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317522.867356:0:82646:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c58fc0700 x1853164291696768/t8589937302(8589937302) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317522.867370:0:82646:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc0700 x1853164291696768/t8589937302(8589937302) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317522.867384:0:82646:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317522.867418:0:82646:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.867430:0:82646:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767317522.867438:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317522.867509:0:82646:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:3.0:1767317522.867525:0:82646:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:3.0:1767317522.867530:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ff 00000080:00010000:3.0:1767317522.867538:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ff from it ffffa7f7c1dafbf0 00010000:00010000:3.0:1767317522.867542:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317522.867552:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767317522.867585:0:82646:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc0700 x1853164291696768/t8589937302(8589937302) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:3.0:1767317522.867714:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffeaba2804 00000002:00010000:3.0:1767317522.867741:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:3.0:1767317522.867818:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82646 initiator: MDT0 00010000:00010000:3.0:1767317522.867826:0:82646:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82646 initiator: MDT0 00000020:00100000:3.0:1767317522.867838:0:82646:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317522.867845:0:82646:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1880 x1853164291697024/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317522.867860:0:82646:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82646 initiator: MDT0 00000100:00100000:3.0:1767317522.867909:0:82646:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291697024:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.868166:0:82646:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317522.872589:0:82646:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291697024:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317522.872617:0:82646:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872629:0:82646:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872641:0:82646:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872653:0:82646:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872665:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872673:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872681:0:82646:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317522.872692:0:82646:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c58fc1880 x1853164291697024/t8589937303(8589937303) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317522.872705:0:82646:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1880 x1853164291697024/t8589937303(8589937303) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317522.872720:0:82646:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872755:0:82646:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317522.872761:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317522.872782:0:82646:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1880 x1853164291697024/t8589937303(8589937303) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317522.872790:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d206 00000080:00010000:0.0:1767317522.872796:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d206 from it ffffa7f7c1dafcc0 00010000:00010000:0.0:1767317522.872800:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317522.872807:0:82646:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317522.873068:0:82646:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317522.873078:0:82646:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:0.0:1767317522.873123:0:82646:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317522.873131:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317522.873153:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317522.873161:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.873171:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317522.873177:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317522.873182:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317522.873185:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:0.0:1767317522.873193:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafcd8 00010000:00010000:0.0:1767317522.873196:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317522.873203:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317522.873599:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=1 00000080:00200080:2.0:1767317522.965860:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317522.967096:0:82646:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317522.967108:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317522.967141:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317522.967158:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.967172:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317522.967180:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317522.967189:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317522.967193:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317522.967199:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafcd8 00010000:00010000:2.0:1767317522.967203:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.967211:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317522.967243:0:82646:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317522.967390:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767317522.967404:0:82646:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317522.967407:0:82646:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317522.967421:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317522.967429:0:82646:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317522.967439:0:82646:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767317522.967447:0:82646:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317522.967462:0:82646:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317522.967464:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317522.967472:0:82646:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317522.967480:0:82646:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317522.967484:0:82646:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317522.967502:0:82646:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317522.967516:0:82646:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317522.967520:0:82646:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179d30, osc lock ffff8c3c61005b50, flags 0x40000 00000080:00200000:2.0:1767317522.967529:0:82646:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767317522.967535:0:82646:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317522.967539:0:82646:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317522.967540:0:82646:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511790b0, osc lock ffff8c3c61004000, flags 0x400001002 00010000:00010000:2.0:1767317522.967587:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317522.967596:0:82646:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317522.967637:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1767317522.967738:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697152:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317522.977152:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317522.977266:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317522.977273:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291697280:192.168.202.133@tcp:400:kworker.0 00010000:00010000:3.0:1767317522.981994:0:2519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982024:0:2519:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982039:0:2519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982052:0:2519:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317522.982067:0:2519:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317522.982080:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1767317522.982105:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982114:0:2519:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982122:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317522.982130:0:2519:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767317522.982151:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697152:192.168.202.133@tcp:101:lfs.0 00000080:00200000:0.0:1767317522.982280:0:82646:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767317522.982286:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.982290:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.982296:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511790b0 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.982300:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead240 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.982313:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511790b0 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.982328:0:82646:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767317522.982333:0:82646:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767317522.982386:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767317522.982389:0:82646:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767317522.982396:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767317522.982399:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.982402:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179d30 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317522.982404:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317522.982407:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179d30 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317522.982413:0:82646:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767317522.982419:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767317522.982438:0:75014:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c588e8d80 00000008:00100000:0.0:1767317522.982484:0:75014:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c50e9c380 - object 0x280000400:161 offset 0<>29 00000100:00100000:0.0:1767317522.982530:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317522.982546:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291697536:192.168.202.133@tcp:3:lfs.0 00000100:00100000:2.0:1767317522.987018:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697408:192.168.202.133@tcp:400:kworker.0 00000008:00010000:0.0:1767317522.994588:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c588e8d80 00000020:00200000:0.0:1767317522.994601:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767317522.994611:0:2518:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:0.0:1767317522.994620:0:2518:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767317522.994632:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767317522.994659:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c588e8d80 00000100:00100000:0.0:1767317522.994685:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291697536:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317522.995083:0:82646:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317522.995098:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317522.995104:0:82646:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317522.995107:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317522.995117:0:82646:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317522.995134:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317522.995173:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:2.0:1767317522.995181:0:82646:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317522.995189:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317522.995217:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317522.995247:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.995275:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317522.995284:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317522.995292:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317522.995296:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317522.995311:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafcd8 00010000:00010000:2.0:1767317522.995315:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317522.995324:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317522.995351:0:82646:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317522.995358:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317522.995368:0:82646:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317522.995371:0:82646:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317522.995380:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317522.995387:0:82646:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317522.995396:0:82646:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767317522.995403:0:82646:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317522.995405:0:82646:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317522.995408:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317522.995416:0:82646:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317522.995423:0:82646:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317522.995427:0:82646:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767317522.995442:0:82646:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317522.995455:0:82646:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317522.995465:0:82646:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317522.995474:0:82646:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317522.995484:0:82646:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317522.995490:0:82646:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317522.995539:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317522.995542:0:82646:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317522.995548:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317522.995551:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317522.995554:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317522.995557:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317522.995560:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317522.995566:0:82646:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317522.995571:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317522.995590:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f180 00000008:00100000:2.0:1767317522.995638:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a39180 - object 0x2c0000400:193 offset 0<>29 00000100:00100000:2.0:1767317522.995676:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291697664:192.168.202.133@tcp:3:lfs.0 00000100:00100000:2.0:1767317522.995831:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291697280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317523.001078:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317523.005140:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190144 00000100:00100000:2.0:1767317523.005155:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190144 00000100:00100000:2.0:1767317523.005221:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9480 00000100:00100000:2.0:1767317523.005231:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36299:x1853164379190144:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317523.005345:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.005437:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317523.005445:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36299:x1853164379190144:12345-192.168.202.133@tcp:104: Request processed in 215us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317523.005453:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9480 00010000:00010000:0.0:1767317523.006928:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317523.006940:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.006952:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317523.006958:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.007076:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.007085:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317523.007392:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291697792:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317523.007488:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.007496:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d1ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f17 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.007519:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.007521:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.007523:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000008:00010000:3.0:1767317523.020462:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f180 00000020:00200000:3.0:1767317523.020475:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.020483:0:2520:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.020491:0:2520:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.020503:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.020524:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f180 00000100:00100000:3.0:1767317523.020551:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291697664:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317523.020783:0:82646:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317523.020807:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.020812:0:82646:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317523.020816:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.020824:0:82646:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317523.020842:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317523.020854:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:2.0:1767317523.020860:0:82646:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.020867:0:82646:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.020955:0:82646:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.021045:0:82646:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.021061:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.021069:0:82646:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.021076:0:82646:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.021079:0:82646:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.021086:0:82646:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c1dafcd8 00010000:00010000:2.0:1767317523.021089:0:82646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.021097:0:82646:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.021208:0:82646:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317523.021216:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.021226:0:82646:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.021733:0:82646:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317523.021745:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.021753:0:82646:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317523.021762:0:82646:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:2.0:1767317523.021769:0:82646:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317523.021772:0:82646:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317523.021775:0:82646:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317523.021782:0:82646:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317523.021801:0:82646:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317523.021806:0:82646:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.021825:0:82646:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317523.021838:0:82646:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317523.021842:0:82646:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317523.021850:0:82646:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317523.021860:0:82646:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317523.021866:0:82646:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317523.022419:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.022423:0:82646:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317523.022430:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.022434:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.022437:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c547fdc68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.022440:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b61d58 (ffff8c3c5a084a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.022443:0:82646:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a084a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.022450:0:82646:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317523.022455:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.022479:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f840 00000008:00100000:2.0:1767317523.022527:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3a680 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767317523.022613:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697920:192.168.202.133@tcp:3:lfs.0 00000100:00100000:1.0:1767317523.024435:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291697792:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:3.0:1767317523.045516:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f840 00000020:00200000:3.0:1767317523.045528:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.045535:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.045542:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.045552:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.045584:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f840 00000100:00100000:3.0:1767317523.045607:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291697920:192.168.202.133@tcp:3:lfs.0 00000080:00200000:0.0:1767317523.045943:0:82646:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317523.045957:0:82646:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317523.045962:0:82646:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767317523.046194:0:82646:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317523.046204:0:82646:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767317523.046223:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317523.071836:0:82646:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffeaba2814 00010000:00010000:0.0:1767317523.071862:0:82646:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.072086:0:82646:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.072094:0:82646:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317523.072214:0:82646:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291698048:192.168.202.133@tcp:103:lfs.0 00000100:00100000:0.0:1767317523.072519:0:82646:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1767317523.079717:0:82646:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291698048:192.168.202.133@tcp:103:lfs.0 00010000:00010000:0.0:1767317523.079747:0:82646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d206 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71f64 expref: -99 pid: 82646 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317523.079806:0:82646:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc1880 x1853164291697024/t8589937303(8589937303) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317523.079818:0:82646:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317523.079823:0:82646:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d880 x1853164291698304/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317523.079844:0:82646:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291698304:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317523.081050:0:82646:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1767317523.087044:0:82646:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82646:1853164291698304:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317523.087092:0:82646:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc1880 x1853164291697024/t8589937303(8589937303) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317523.087155:0:82646:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154000 00010000:00010000:0.0:1767317523.087184:0:82646:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.104102:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.104458:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.104476:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.104499:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.104508:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.104517:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.104521:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.104528:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14d3b58 00010000:00010000:2.0:1767317523.104532:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.104541:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.104556:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.104564:0:82647:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=9 00000080:00200008:2.0:1767317523.104574:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.104579:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.104592:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.104600:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.104608:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.104614:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.104617:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.104620:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.104630:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cb8 00010000:00010000:2.0:1767317523.104633:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.104639:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.104753:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.104761:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.104768:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.104776:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.104782:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.104786:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.104789:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.104793:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14d3bf8 00010000:00010000:2.0:1767317523.104796:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.104803:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.104811:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.104815:0:82647:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:2.0:1767317523.104820:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 44 00000080:00200008:2.0:1767317523.104827:0:82647:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154400 00000080:00200080:2.0:1767317523.104905:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7ffda0f677f4 00000002:00010000:2.0:1767317523.104922:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:2.0:1767317523.104984:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82647 initiator: MDT0 00010000:00010000:2.0:1767317523.104992:0:82647:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000020:00100000:2.0:1767317523.105004:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317523.105016:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38a80 x1853164291698560/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317523.105027:0:82647:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82647 initiator: MDT0 00000100:00100000:2.0:1767317523.105049:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291698560:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.106283:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820ebcc0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.112227:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291698560:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.112256:0:82647:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112268:0:82647:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112281:0:82647:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112291:0:82647:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112314:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112322:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112329:0:82647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317523.112367:0:82647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c46a38a80 x1853164291698560/t8589937305(8589937305) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317523.112379:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38a80 x1853164291698560/t8589937305(8589937305) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317523.112395:0:82647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112407:0:82647:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317523.112413:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317523.112436:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38a80 x1853164291698560/t8589937305(8589937305) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317523.112448:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d214 00000080:00010000:0.0:1767317523.112453:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d214 from it ffffa7f7c14d3cc0 00010000:00010000:0.0:1767317523.112457:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.112463:0:82647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317523.112685:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317523.112694:0:82647:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:0.0:1767317523.112727:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317523.112735:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317523.112756:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317523.112766:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.112782:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.112789:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317523.112795:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317523.112798:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:0.0:1767317523.112803:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:0.0:1767317523.112805:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.112813:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317523.112906:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=1 00000080:00200080:3.0:1767317523.186858:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317523.186900:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317523.186910:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317523.186944:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317523.186962:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.186979:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.186987:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.186998:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317523.187002:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:3.0:1767317523.187010:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:3.0:1767317523.187014:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.187023:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317523.187053:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767317523.187065:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00020000:00200000:3.0:1767317523.187078:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.187081:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317523.187092:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.187101:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767317523.188524:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317523.188533:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317523.188536:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767317523.188542:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767317523.188561:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317523.188569:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317523.188572:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317523.188594:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317523.188610:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317523.188614:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb50a0, flags 0x40000 00000080:00200000:3.0:1767317523.188622:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767317523.188635:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317523.188720:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317523.188781:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317523.188785:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317523.188793:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.188796:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.188799:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.188801:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.188804:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.188813:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317523.188818:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317523.188845:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bac00 00000008:00100000:3.0:1767317523.188913:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc1180 - object 0x280000400:161 offset 0<>29 00000100:00100000:3.0:1767317523.188960:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317523.188985:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698688:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317523.201748:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bac00 00000020:00200000:3.0:1767317523.201762:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.201771:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.201779:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.201804:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.201839:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bac00 00000100:00100000:3.0:1767317523.201866:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698688:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317523.203072:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317523.203093:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.203099:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317523.203186:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.203201:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317523.203221:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317523.203484:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:2.0:1767317523.203494:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.203502:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.203535:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.203553:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.203586:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.203594:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.203602:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.203606:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.203614:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:2.0:1767317523.203617:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.203626:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.203780:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317523.203789:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.204067:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.204071:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317523.204081:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.204089:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317523.204100:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767317523.204203:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317523.204206:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317523.204209:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317523.204219:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317523.204226:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317523.204230:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767317523.204443:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317523.204461:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317523.204473:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317523.204482:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317523.204495:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317523.204502:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317523.204557:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.204560:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317523.204567:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.204570:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.204573:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.204576:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.204578:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.205921:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317523.205936:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.205973:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fcc0 00000008:00100000:2.0:1767317523.206028:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a38700 - object 0x2c0000400:193 offset 0<>29 00000100:00100000:3.0:1767317523.206117:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698816:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317523.211723:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fcc0 00000020:00200000:3.0:1767317523.211736:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.211744:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.211753:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.211764:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.212506:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fcc0 00000100:00100000:3.0:1767317523.212536:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698816:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317523.212633:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317523.212722:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.212728:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317523.212732:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.212740:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317523.212758:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317523.212771:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:2.0:1767317523.212778:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.212785:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.212829:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.212847:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.212861:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.212918:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.212925:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.212929:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.212936:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:2.0:1767317523.212940:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.212949:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.212983:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317523.212991:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.213002:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.213005:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317523.213013:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.213019:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317523.213028:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:2.0:1767317523.213035:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317523.213036:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317523.213039:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317523.213046:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317523.213052:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317523.213055:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.213070:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317523.213084:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317523.213088:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317523.213096:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317523.213115:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317523.213122:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317523.213175:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.213178:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317523.213186:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.213188:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.213191:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a084b48/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.213195:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.213197:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.213204:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317523.213209:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.213225:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f540 00000008:00100000:2.0:1767317523.216531:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a39880 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767317523.216614:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317523.217868:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698944:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317523.221896:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f540 00000020:00200000:3.0:1767317523.221908:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.221916:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.221924:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.221935:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.222019:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f540 00000100:00100000:3.0:1767317523.222047:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291698944:192.168.202.133@tcp:3:lfs.0 00000080:00200000:0.0:1767317523.222781:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317523.222906:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317523.222912:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767317523.222916:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317523.222927:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767317523.222944:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00010000:00010000:1.0:1767317523.297146:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:3.0:1767317523.332743:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317523.332764:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317523.332774:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317523.332931:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317523.332951:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.333040:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.333058:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.333070:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317523.333074:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:3.0:1767317523.333082:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:3.0:1767317523.333085:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.333093:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317523.333124:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:3.0:1767317523.333136:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317523.333148:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.333151:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317523.333161:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.333197:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767317523.333202:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.333204:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.333206:0:82647:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.333468:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.333472:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb50a0, flags 0x400000400001002 00010000:00010000:3.0:1767317523.333491:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.333502:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317523.333531:0:82647:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.333541:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.333544:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.333552:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.333562:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.333572:0:82647:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.333576:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.333579:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.333582:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c5a084cf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.333586:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.333590:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a0843f8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.333599:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.333604:0:82647:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:3.0:1767317523.333610:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767317523.333618:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317523.333625:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317523.333627:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767317523.333629:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767317523.333638:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317523.333644:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317523.333653:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317523.333667:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317523.333674:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317523.333677:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb50a0, flags 0x40000 00000080:00200000:3.0:1767317523.333683:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767317523.333693:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317523.333699:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317523.333752:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317523.333756:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317523.333761:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.333764:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.333767:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c5a0843f8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.333769:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.333772:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a084f38/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.333778:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317523.333783:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317523.334459:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bae40 00000008:00100000:3.0:1767317523.334514:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc1180 - object 0x280000400:161 offset 0<>29 00000100:00100000:2.0:1767317523.334575:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317523.334662:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291699072:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317523.346672:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bae40 00000020:00200000:3.0:1767317523.346686:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.346693:0:2520:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.346702:0:2520:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.346714:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.346734:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bae40 00000100:00100000:3.0:1767317523.346759:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291699072:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317523.346955:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317523.346980:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.346985:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317523.346988:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.346999:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317523.347022:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317523.347034:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:2.0:1767317523.347041:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.347049:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.347078:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.347098:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.347113:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.347139:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.347147:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.347152:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.347160:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:2.0:1767317523.347164:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.347173:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.347211:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:2.0:1767317523.347218:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.347229:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.347391:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317523.347402:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.347409:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.347414:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.347416:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317523.347418:0:82647:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317523.347436:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317523.347440:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x400000400001002 00010000:00010000:2.0:1767317523.347461:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.347474:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.347495:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317523.347498:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.347505:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.347517:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.347523:0:82647:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:2.0:1767317523.347527:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.347530:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.347533:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a084758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.347537:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.347540:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a0843f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.347546:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.347550:0:82647:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:2.0:1767317523.347557:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317523.347564:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767317523.347571:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317523.347573:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317523.347575:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317523.347583:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317523.347590:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317523.347594:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767317523.347608:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317523.347615:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317523.347617:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317523.347623:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317523.347639:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317523.347646:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317523.347697:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.347699:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317523.347705:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.347708:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.347710:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a0843f8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.347713:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.347715:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a084f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.347721:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317523.347727:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.347746:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993f0c0 00000008:00100000:2.0:1767317523.347788:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3b100 - object 0x2c0000400:193 offset 0<>29 00000100:00100000:3.0:1767317523.348140:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317523.348160:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291699200:192.168.202.133@tcp:3:lfs.0 00000008:00010000:3.0:1767317523.356469:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993f0c0 00000020:00200000:3.0:1767317523.356483:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767317523.356491:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767317523.356513:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767317523.356523:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767317523.356595:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993f0c0 00000100:00100000:3.0:1767317523.356621:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291699200:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317523.360693:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317523.360714:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.360720:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317523.360725:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.360740:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317523.360758:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317523.360772:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:2.0:1767317523.360779:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.360787:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.360822:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.360839:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.360855:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.360863:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.360902:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.360906:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.360913:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:2.0:1767317523.360917:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.360926:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.360955:0:82647:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:2.0:1767317523.360963:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.360974:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.360977:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317523.360985:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.360991:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.360994:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.360996:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317523.361000:0:82647:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317523.361019:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317523.361022:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x400000400001002 00010000:00010000:2.0:1767317523.361039:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.361049:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.361059:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317523.361063:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.361079:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.361090:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.361097:0:82647:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:2.0:1767317523.361101:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.361104:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.361107:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a084758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.361111:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eae480 (ffff8c3c5a0843f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.361114:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a0843f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.361121:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.361126:0:82647:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:2.0:1767317523.361132:0:82647:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317523.361139:0:82647:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:2.0:1767317523.361147:0:82647:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317523.361150:0:82647:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317523.361153:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767317523.361162:0:82647:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317523.361168:0:82647:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317523.361173:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.361381:0:82647:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317523.361390:0:82647:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317523.361392:0:82647:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179930, osc lock ffff8c3c61004ab0, flags 0x40000 00000080:00200000:2.0:1767317523.361398:0:82647:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317523.361408:0:82647:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317523.361415:0:82647:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317523.361469:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.361473:0:82647:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317523.361485:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.361488:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.361491:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179930 (ffff8c3c5a0843f8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.361494:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d17f6c8 (ffff8c3c5a084f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.361496:0:82647:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179930 (ffff8c3c5a084f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.361502:0:82647:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317523.361507:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.361537:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fd80 00000008:00100000:2.0:1767317523.361584:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a38000 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767317523.361671:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291699328:192.168.202.133@tcp:3:lfs.0 00000008:00010000:2.0:1767317523.368441:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fd80 00000020:00200000:2.0:1767317523.368454:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317523.368460:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767317523.368468:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317523.368479:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317523.368502:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fd80 00000100:00100000:2.0:1767317523.368529:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291699328:192.168.202.133@tcp:3:lfs.0 00000080:00200000:3.0:1767317523.368798:0:82647:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317523.368811:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.368817:0:82647:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767317523.368820:0:82647:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.368828:0:82647:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767317523.368844:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200000:2.0:1767317523.392533:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.392568:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.392587:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.392607:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.392615:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.392623:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.392627:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.392634:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14d3bf8 00010000:00010000:2.0:1767317523.392638:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.392658:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.392673:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.392681:0:82647:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:2.0:1767317523.392688:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 44 00000080:00200008:2.0:1767317523.392695:0:82647:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154400 00000002:00010000:2.0:1767317523.392712:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:2.0:1767317523.392764:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82647 initiator: MDT0 00010000:00010000:2.0:1767317523.392770:0:82647:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000020:00100000:2.0:1767317523.392781:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317523.392792:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38000 x1853164291699584/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317523.392801:0:82647:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000100:00100000:2.0:1767317523.392823:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291699584:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.393014:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820ebcc0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317523.412713:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291699584:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317523.412746:0:82647:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.412757:0:82647:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.412786:0:82647:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.412810:0:82647:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317523.412825:0:82647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c46a38000 x1853164291699584/t8589937306(8589937306) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767317523.412838:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38000 x1853164291699584/t8589937306(8589937306) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317523.412853:0:82647:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317523.412866:0:82647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.412926:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.412936:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.412943:0:82647:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.412949:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.413155:0:82647:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.413190:0:82647:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:2.0:1767317523.413198:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00010000:00010000:1.0:1767317523.413356:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.413364:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413371:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.413375:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413383:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413391:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413415:0:63490:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413450:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413456:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.413491:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413498:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d21b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71fd4 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.413513:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.413515:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.413516:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.413525:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317523.413541:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291699712:192.168.202.133@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1767317523.414390:0:82647:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:2.0:1767317523.414413:0:82647:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:2.0:1767317523.414420:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1ff 00000080:00010000:2.0:1767317523.414427:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1ff from it ffffa7f7c14d3bf0 00010000:00010000:2.0:1767317523.414432:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.414442:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767317523.414476:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38000 x1853164291699584/t8589937306(8589937306) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317523.414617:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:2.0:1767317523.414625:0:82647:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:2.0:1767317523.414650:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.414658:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.414679:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.414689:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.414698:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.414710:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.414717:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.414720:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d1f8 00000080:00010000:2.0:1767317523.414724:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d1f8 from it ffffa7f7c14d3cd8 00010000:00010000:2.0:1767317523.414728:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.414735:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.414769:0:82647:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154000 00010000:00010000:2.0:1767317523.414781:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.415380:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.415392:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.415402:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.415410:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.415416:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.415421:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.415424:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.415428:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14d3bf8 00010000:00010000:2.0:1767317523.415431:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.415448:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.415458:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.415465:0:82647:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:2.0:1767317523.415471:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 46 00000080:00200008:2.0:1767317523.415479:0:82647:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 100002 00000002:00010000:2.0:1767317523.415493:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100003 00010000:00010000:2.0:1767317523.415505:0:82647:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x81008400000000 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.415552:0:82647:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.415558:0:82647:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317523.415560:0:82647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d214 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a71f95 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.415582:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82647 initiator: MDT0 00010000:00010000:2.0:1767317523.415587:0:82647:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000020:00100000:2.0:1767317523.415600:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317523.415611:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3aa00 x1853164291699968/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317523.415621:0:82647:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000100:00100000:2.0:1767317523.415651:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291699968:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.416335:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c820ebcc0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317523.420626:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:1.0:1767317523.421441:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291699712:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317523.424019:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190272 00000100:00100000:2.0:1767317523.424037:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190272 00000100:00100000:2.0:1767317523.424103:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9481 00000100:00100000:2.0:1767317523.424113:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190272:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317523.424130:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.424464:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317523.424472:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190272:12345-192.168.202.133@tcp:104: Request processed in 360us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317523.424480:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9481 00010000:00010000:0.0:1767317523.429365:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317523.429379:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429392:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317523.429398:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429428:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429437:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429466:0:60279:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429521:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429528:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317523.429561:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429568:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d1f8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f41 expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.429582:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.429584:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.429586:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317523.429594:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317523.429615:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291700096:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.445760:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291700096:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317523.446384:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291699968:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.446409:0:82647:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446447:0:82647:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446455:0:82647:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446467:0:82647:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446478:0:82647:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446491:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446498:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446505:0:82647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317523.446514:0:82647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c46a3aa00 x1853164291699968/t8589937307(8589937307) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317523.446526:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3aa00 x1853164291699968/t8589937307(8589937307) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317523.446541:0:82647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.446564:0:82647:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317523.446571:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317523.451610:0:82647:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:1.0:1767317523.451627:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d222 00000080:00010000:1.0:1767317523.451639:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d222 from it ffffa7f7c14d3bf0 00010000:00010000:1.0:1767317523.451644:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.451676:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317523.451720:0:82647:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3aa00 x1853164291699968/t8589937307(8589937307) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317523.451830:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:1.0:1767317523.451838:0:82647:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:1.0:1767317523.451864:0:82647:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317523.451887:0:82647:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:1.0:1767317523.451903:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317523.451919:0:82647:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767317523.452448:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82647 initiator: MDT0 00010000:00010000:1.0:1767317523.452458:0:82647:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00010000:00010000:1.0:1767317523.452469:0:82647:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000100:00100000:1.0:1767317523.452493:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291700224:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317523.452585:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:2.0:1767317523.458977:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.459186:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317523.459207:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190400 00000100:00100000:3.0:1767317523.459217:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190400 00000100:00100000:3.0:1767317523.459360:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9482 00000100:00100000:3.0:1767317523.459371:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190400:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.459388:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317523.459836:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317523.459844:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190400:12345-192.168.202.133@tcp:104: Request processed in 475us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.459852:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9482 00010000:00010000:1.0:1767317523.463805:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.463819:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.463831:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.463854:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.463862:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.463885:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.463917:0:64002:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.463974:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.463981:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.464011:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.464017:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d222 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71fe9 expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.464034:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.464036:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.464037:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.464052:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317523.464076:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291700352:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.466920:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291700352:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.467708:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291700224:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317523.467747:0:82647:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467760:0:82647:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467774:0:82647:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467785:0:82647:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467809:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467816:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.467823:0:82647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317523.467834:0:82647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291700224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317523.467846:0:82647:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317523.467859:0:82647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.467903:0:82647:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317523.467910:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317523.467958:0:82647:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767317523.467980:0:82647:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:1.0:1767317523.467986:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d229 00000080:00010000:1.0:1767317523.467992:0:82647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317523.467995:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d229 from it ffffa7f7c14d3cd8 00010000:00010000:1.0:1767317523.467998:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.468007:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317523.468066:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=801066da arg=7ffda0f67600 00000080:00200000:1.0:1767317523.468077:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:1.0:1767317523.468087:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317523.468090:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317523.468096:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000100:00100000:0.0:1767317523.468212:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317523.468229:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291700480:192.168.202.133@tcp:1:lfs.0 00000100:00100000:2.0:1767317523.474358:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.474516:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190528 00000100:00100000:3.0:1767317523.474527:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190528 00000100:00100000:3.0:1767317523.474584:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9483 00000100:00100000:3.0:1767317523.474595:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:40595:x1853164379190528:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.474621:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.474706:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317523.474713:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:40595:x1853164379190528:12345-192.168.202.133@tcp:104: Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.474720:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9483 00010000:00010000:1.0:1767317523.474952:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.474969:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.474978:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317523.474985:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317523.475007:0:63743:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317523.475029:0:63743:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317523.475070:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.475077:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.475110:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.475118:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d1e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a71f02 expref: -99 pid: 82645 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.475141:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.475143:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.475145:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317523.475666:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317523.475686:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291700608:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.485753:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291700480:192.168.202.133@tcp:1:lfs.0 00000080:00200000:2.0:1767317523.485945:0:82647:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 2 00000080:00200000:2.0:1767317523.485969:0:82647:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov.set.flags 00010000:00010000:2.0:1767317523.486010:0:82647:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.486063:0:82647:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.486069:0:82647:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317523.486072:0:82647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cf200/0x73c3d5cb1442d12d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a71d11 expref: -99 pid: 82495 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317523.486109:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317523.486117:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3bb80 x1853164291700864/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 624/440 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317523.486140:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291700864:192.168.202.133@tcp:36:lfs.0 00000100:00100000:2.0:1767317523.486205:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.491404:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291700608:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317523.507550:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.507593:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.507618:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.507647:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190656 00000100:00100000:3.0:1767317523.507656:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190656 00000100:00100000:3.0:1767317523.507695:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190784 00000100:00100000:3.0:1767317523.507698:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190784 00000100:00100000:3.0:1767317523.507709:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379190912 00000100:00100000:3.0:1767317523.507711:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379190912 00000100:00100000:3.0:1767317523.507722:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9484 00000100:00100000:3.0:1767317523.507732:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+7:19247:x1853164379190656:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.507750:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.507838:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317523.507845:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+7:19247:x1853164379190656:12345-192.168.202.133@tcp:104: Request processed in 115us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.507852:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9484 00000100:00100000:3.0:1767317523.507912:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9485 00000100:00100000:3.0:1767317523.507920:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:19247:x1853164379190784:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.507943:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.507972:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1767317523.507978:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+6:19247:x1853164379190784:12345-192.168.202.133@tcp:104: Request processed in 59us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.507985:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9485 00000100:00100000:3.0:1767317523.507998:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9486 00000100:00100000:3.0:1767317523.508004:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190912:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.508011:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.508041:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1767317523.508048:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19247:x1853164379190912:12345-192.168.202.133@tcp:104: Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.508053:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9486 00010000:00010000:3.0:1767317523.508070:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1767317523.508076:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.508084:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:3.0:1767317523.508089:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.508097:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.508104:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.508136:0:42098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767317523.508187:0:42098:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a38000 x1853164291699584/t8589937306(8589937306) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317523.508198:0:42098:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1767317523.508203:0:42098:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1180 x1853164291701120/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317523.508226:0:42098:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:42098:1853164291701120:192.168.202.133@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1767317523.508280:0:42098:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8180 going to sleep for 11 seconds 00010000:00010000:1.0:1767317523.508616:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1767317523.508624:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508631:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58cccc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.508635:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508641:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508648:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508675:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508708:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508715:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.508734:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508742:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d1f1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f25 expref: -99 pid: 82645 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508757:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.508760:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508766:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.508769:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508776:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508783:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317523.508798:0:42099:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317523.508821:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508834:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.508841:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508849:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d229 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71ffe expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.508860:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.508861:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.508863:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.508917:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291701376:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.508964:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317523.508970:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291701248:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317523.509097:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.515944:0:42098:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:42098:1853164291701120:192.168.202.133@tcp:35:ldlm_bl.0 00000002:00100000:1.0:1767317523.516041:0:42098:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a38000 x1853164291699584/t8589937306(8589937306) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317523.516115:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.516125:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.516145:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.516154:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d1ff lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a71f4f expref: -99 pid: 82646 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1767317523.517065:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291701504:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317523.517652:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.517655:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.517657:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317523.517702:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291701376:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317523.522124:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291701248:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317523.525161:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291701504:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317523.526426:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291700864:192.168.202.133@tcp:36:lfs.0 00000080:00200008:2.0:1767317523.526471:0:82647:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 100002 00000002:00100000:2.0:1767317523.526532:0:82647:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a3aa00 x1853164291699968/t8589937307(8589937307) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317523.526545:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317523.526550:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b480 x1853164291701760/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317523.526574:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291701760:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317523.526653:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 11 seconds 00000100:00100000:2.0:1767317523.532565:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291701760:192.168.202.133@tcp:35:lfs.0 00000002:00100000:2.0:1767317523.532607:0:82647:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a3aa00 x1853164291699968/t8589937307(8589937307) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1767317523.532711:0:82647:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7ffda0f67804 00000002:00100000:2.0:1767317523.532761:0:82647:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a38a80 x1853164291698560/t8589937305(8589937305) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317523.532772:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317523.532777:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b480 x1853164291702016/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317523.532822:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702016:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317523.532947:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 11 seconds 00000100:00100000:2.0:1767317523.535454:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702016:192.168.202.133@tcp:35:lfs.0 00000002:00100000:2.0:1767317523.535488:0:82647:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a38a80 x1853164291698560/t8589937305(8589937305) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767317523.535528:0:82647:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:2.0:1767317523.535539:0:82647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:2.0:1767317523.535584:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82647 initiator: MDT0 00010000:00010000:2.0:1767317523.535594:0:82647:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00010000:00010000:2.0:1767317523.535603:0:82647:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82647 initiator: MDT0 00000100:00100000:2.0:1767317523.535620:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702144:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.535840:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 12 seconds 00000100:00100000:2.0:1767317523.553825:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702144:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317523.553865:0:82647:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554029:0:82647:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767317523.554045:0:82647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c46a3b480 x1853164291702144/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317523.554075:0:82647:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767317523.554086:0:82647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554098:0:82647:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767317523.554104:0:82647:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317523.554120:0:82647:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d230 00000080:00010000:2.0:1767317523.554128:0:82647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d230 from it ffffa7f7c14d3bc8 00010000:00010000:2.0:1767317523.554132:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554141:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554163:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554624:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317523.554635:0:82647:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554781:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554790:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.554813:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767317523.554823:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.554826:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317523.554833:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.554861:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1767317523.554906:0:82647:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.554914:0:82647:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767317523.554920:0:82647:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.554936:0:82647:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317523.554942:0:82647:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.554944:0:82647:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317523.554946:0:82647:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.554955:0:82647:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1767317523.555084:0:82647:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317522 1767317521 1767317521 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317521 1767317521 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317523.555164:0:82647:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 9 00010000:00010000:2.0:1767317523.555448:0:82647:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.555457:0:82647:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.555583:0:82647:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154000 00000002:00100000:2.0:1767317523.555632:0:82647:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc0700 x1853164291696768/t8589937302(8589937302) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317523.555643:0:82647:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317523.555649:0:82647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b480 x1853164291702400/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317523.555776:0:82647:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702400:192.168.202.133@tcp:35:lfs.0 00000100:00100000:2.0:1767317523.556186:0:82647:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 11 seconds 00000100:00100000:2.0:1767317523.563898:0:82647:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82647:1853164291702400:192.168.202.133@tcp:35:lfs.0 00000002:00100000:2.0:1767317523.563937:0:82647:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc0700 x1853164291696768/t8589937302(8589937302) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317523.592665:0:82649:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317523.592713:0:82649:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317523.592730:0:82649:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317523.592747:0:82649:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317523.592756:0:82649:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.592763:0:82649:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317523.592767:0:82649:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:3.0:1767317523.592773:0:82649:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483bf8 00010000:00010000:3.0:1767317523.592777:0:82649:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317523.592786:0:82649:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317523.592809:0:82649:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317523.592823:0:82649:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c43b88780, open_flags 18800, mode 0 opened 0 00000080:00200000:3.0:1767317523.592831:0:82649:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:3.0:1767317523.592846:0:82649:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:3.0:1767317523.592934:0:82649:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82649 initiator: MDT0 00010000:00010000:3.0:1767317523.592941:0:82649:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82649 initiator: MDT0 00000020:00100000:3.0:1767317523.592953:0:82649:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317523.593317:0:82649:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0a80 x1853164291702656/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317523.593330:0:82649:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82649 initiator: MDT0 00000100:00100000:3.0:1767317523.593354:0:82649:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82649:1853164291702656:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317523.593532:0:82649:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac86c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.607402:0:82649:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82649:1853164291702656:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.607422:0:82649:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607431:0:82649:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607436:0:82649:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607440:0:82649:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607459:0:82649:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607464:0:82649:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317523.607467:0:82649:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607471:0:82649:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607476:0:82649:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607481:0:82649:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317523.607486:0:82649:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82649 initiator: MDT0 00010000:00010000:0.0:1767317523.607489:0:82649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82649 initiator: MDT0 00000002:00100000:0.0:1767317523.607504:0:82649:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c58fc0a80 x1853164291702656/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317523.607516:0:82649:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:1.0:1767317523.608368:0:82649:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317523.608398:0:82649:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317523.608413:0:82649:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.608426:0:82649:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317523.608433:0:82649:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317523.608439:0:82649:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317523.608443:0:82649:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:1.0:1767317523.608449:0:82649:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483bb0 00010000:00010000:1.0:1767317523.608453:0:82649:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.608461:0:82649:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317523.608475:0:82649:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317523.608486:0:82649:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:1.0:1767317523.608525:0:82649:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=97f3d0 00000100:00100000:1.0:1767317523.608585:0:82649:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82649:1853164291702784:192.168.202.133@tcp:34:lfs.0 00000100:00100000:1.0:1767317523.608735:0:82649:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317523.623307:0:82649:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82649:1853164291702784:192.168.202.133@tcp:34:lfs.0 00000080:00200008:1.0:1767317523.623631:0:82649:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:2.0:1767317523.672614:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.672652:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.672671:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.672688:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.672695:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.672703:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.672706:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.672713:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14f3b58 00010000:00010000:2.0:1767317523.672717:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.672733:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.672748:0:82651:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.672762:0:82651:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:2.0:1767317523.672766:0:82651:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317523.672780:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.672830:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:2.0:1767317523.672839:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:2.0:1767317523.672848:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:2.0:1767317523.674708:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291702912:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.674892:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 12 seconds 00000100:00100000:2.0:1767317523.683217:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291702912:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317523.683246:0:82651:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683262:0:82651:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683270:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683308:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683320:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683332:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683339:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683346:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317523.683355:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291702912/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317523.683366:0:82651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317523.683377:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.683387:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767317523.683405:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317523.683460:0:82651:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:2.0:1767317523.683464:0:82651:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:2.0:1767317523.683480:0:82651:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 9 -> 9 00000080:00010000:2.0:1767317523.683491:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d23e 00000080:00010000:2.0:1767317523.683503:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.683506:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d23e from it ffffa7f7c14f3b20 00010000:00010000:2.0:1767317523.683510:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.683518:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317523.683554:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.683561:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.683582:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.683590:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.683599:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.683605:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.683609:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.683611:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d23e 00000080:00010000:2.0:1767317523.683615:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d23e from it ffffa7f7c14f3cb8 00010000:00010000:2.0:1767317523.683618:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.683624:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.683675:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317523.683689:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.683696:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683703:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.683708:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.683712:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317523.683714:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317523.683717:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c14f3bf8 00010000:00010000:2.0:1767317523.683720:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.683726:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.683734:0:82651:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317523.683741:0:82651:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:2.0:1767317523.683746:0:82651:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 46 00000080:00200008:2.0:1767317523.683755:0:82651:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154402 00000002:00010000:2.0:1767317523.683769:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:2.0:1767317523.683813:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:2.0:1767317523.683820:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000020:00100000:2.0:1767317523.683829:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317523.683836:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b480 x1853164291703168/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317523.683851:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:2.0:1767317523.685399:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703168:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.685621:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317523.690389:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317523.690648:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379192960 00000100:00100000:2.0:1767317523.690660:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379192960 00000100:00100000:2.0:1767317523.690718:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9487 00000100:00100000:2.0:1767317523.690728:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379192960:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317523.690745:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.690823:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317523.690829:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379192960:12345-192.168.202.133@tcp:104: Request processed in 103us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317523.690835:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9487 00010000:00010000:0.0:1767317523.690908:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317523.690916:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.690924:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317523.690929:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.690957:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.690975:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.691002:0:63742:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.691040:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.691046:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317523.691081:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.691087:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d23e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a72059 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.691103:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.691105:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.691107:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317523.691115:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317523.691129:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291703296:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317523.695628:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291703296:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317523.697178:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703168:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317523.697204:0:82651:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697223:0:82651:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697231:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697242:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697265:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697278:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697286:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697293:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317523.697356:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767317523.697369:0:82651:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317523.697384:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697395:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767317523.697402:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317523.697456:0:82651:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:2.0:1767317523.697462:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d245 00000080:00010000:2.0:1767317523.697469:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d245 from it ffffa7f7c14f3bf0 00010000:00010000:2.0:1767317523.697472:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.697491:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317523.697518:0:82651:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317523.697662:0:82651:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:2.0:1767317523.697670:0:82651:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:2.0:1767317523.697700:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.697706:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.697721:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.697728:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:2.0:1767317523.697764:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:2.0:1767317523.697771:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:2.0:1767317523.697779:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:2.0:1767317523.697799:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703424:192.168.202.133@tcp:101:lfs.0 00000100:00100000:2.0:1767317523.697866:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c41377e40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317523.701037:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317523.701267:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379193088 00000100:00100000:2.0:1767317523.701277:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379193088 00000100:00100000:2.0:1767317523.701344:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9488 00000100:00100000:2.0:1767317523.701355:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379193088:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317523.701370:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.701513:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317523.701522:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379193088:12345-192.168.202.133@tcp:104: Request processed in 169us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317523.701529:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9488 00010000:00010000:1.0:1767317523.703159:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.703171:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.703183:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.703188:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.703195:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.703203:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.703355:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.703380:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317523.703440:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291703552:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317523.703582:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.703590:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0a00/0x73c3d5cb1442d245 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72067 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.703604:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.703606:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317523.703608:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.708729:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703424:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317523.708753:0:82651:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.708764:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.708775:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.708783:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.708993:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.709001:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.709017:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317523.709028:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38a80 x1853164291703424/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317523.709039:0:82651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317523.709053:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.709066:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317523.709073:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317523.709126:0:82651:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767317523.709140:0:82651:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 9 -> 9 00000080:00010000:1.0:1767317523.709146:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d24c 00000080:00010000:1.0:1767317523.709152:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:1.0:1767317523.709155:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d24c from it ffffa7f7c14f3cd8 00010000:00010000:1.0:1767317523.709158:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.710446:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767317523.710532:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=26562a0 00000002:00010000:1.0:1767317523.710561:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1767317523.710654:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:1.0:1767317523.710661:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000020:00100000:1.0:1767317523.710760:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317523.710771:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291703808/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317523.710781:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 82651 initiator: MDT0 00000100:00100000:1.0:1767317523.710914:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703808:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317523.711253:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.711743:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291703552:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.719060:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291703808:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317523.719092:0:82651:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719198:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719211:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719375:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719391:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719398:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719405:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317523.719417:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317523.719429:0:82651:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317523.719445:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317523.719459:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767317523.719466:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1767317523.719576:0:82651:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767317523.719585:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d253 00000080:00010000:2.0:1767317523.719592:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d253 from it ffffa7f7c14f3cc0 00010000:00010000:2.0:1767317523.719595:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.719602:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.719665:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767317523.719779:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.719783:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317523.721073:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000100:00100000:3.0:1767317523.721462:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291703936:192.168.202.133@tcp:1:lfs.0 00000100:00100000:2.0:1767317523.743616:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291703936:192.168.202.133@tcp:1:lfs.0 00010000:00010000:0.0:1767317523.743761:0:82651:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.743787:0:82651:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317523.743807:0:82651:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.743815:0:82651:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317523.743845:0:82651:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.743853:0:82651:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.743859:0:82651:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317523.743862:0:82651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d24c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7207c expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.743933:0:82651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d230 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72013 expref: -99 pid: 82647 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317523.743948:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317523.743956:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291704192/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317523.743980:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704192:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317523.744052:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.758528:0:82651:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937316 gen 1 00000100:00100000:0.0:1767317523.758830:0:82651:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317523.758844:0:82651:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317523.758855:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704192:192.168.202.133@tcp:36:lfs.0 00010000:00010000:0.0:1767317523.758919:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:0.0:1767317523.758933:0:82651:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:0.0:1767317523.758944:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317523.759496:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.759506:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.759515:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:0.0:1767317523.759794:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704320:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317523.759923:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.762974:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704320:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.763008:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763023:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317523.763039:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9dc00 x1853164291704320/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317523.763049:0:82651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317523.763060:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763073:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317523.763079:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317523.763096:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d25a 00000080:00010000:0.0:1767317523.763104:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d25a from it ffffa7f7c14f3c70 00010000:00010000:0.0:1767317523.763108:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763116:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763156:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763166:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317523.763174:0:82651:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763402:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763409:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.763424:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317523.763434:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.763438:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317523.763444:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317523.763472:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317523.763485:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763493:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317523.763499:0:82651:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.763531:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317523.763537:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.763539:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317523.763541:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317523.763551:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317523.763625:0:82651:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 10 00010000:00010000:0.0:1767317523.763630:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.763637:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317523.763658:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=26562a0 00000080:00200008:0.0:1767317523.764509:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317523.764522:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317523.764540:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317523.764549:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767317523.764589:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.764597:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.764606:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:0.0:1767317523.764631:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704448:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317523.764726:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.771523:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291704448:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.771609:0:82651:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771622:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771634:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771644:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771656:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771664:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.771671:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317523.771692:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9dc00 x1853164291704448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/928 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317523.771704:0:82651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317523.771719:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.771751:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317523.771759:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317523.771824:0:82651:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 10 -> 10 00000080:00010000:0.0:1767317523.771829:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:0.0:1767317523.771834:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317523.771837:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:0.0:1767317523.771840:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.771848:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.771900:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 9 restore needed 0 00020000:00200000:0.0:1767317523.771912:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.771914:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317523.771918:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317523.771935:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317523.771939:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287130, osc lock ffff8c3c50c8ebe0, flags 0x400000400001002 00010000:00010000:0.0:1767317523.771986:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.771994:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.772003:0:82651:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9dc00 x1853164291704576/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767317523.772045:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767317523.772063:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317523.772081:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291704576:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.775466:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775493:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775508:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775521:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317523.775537:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317523.775560:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317523.775646:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775657:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775665:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.775703:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317523.775722:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291704576:192.168.202.133@tcp:101:lfs.0 00000080:00200000:1.0:1767317523.776514:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767317523.776523:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317523.776527:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317523.776533:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287130 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317523.776539:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317523.776663:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287130 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317523.776742:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1767317523.858149:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:2.0:1767317523.858171:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317523.858181:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317523.858209:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317523.858229:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.861397:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.861410:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317523.861423:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317523.861427:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:2.0:1767317523.861437:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:2.0:1767317523.861442:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317523.861452:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317523.861486:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1767317523.861500:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.861504:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767317523.861508:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767317523.861531:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767317523.861534:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61004ab0, flags 0x400000400001002 00010000:00010000:2.0:1767317523.861565:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861576:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.861588:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767317523.861592:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861606:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767317523.861616:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317523.861627:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767317523.861632:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.861635:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.861638:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.861642:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.861645:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.861656:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767317523.861680:0:82651:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1767317523.861687:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:2.0:1767317523.861691:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317523.861693:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317523.861698:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317523.861714:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:2.0:1767317523.861722:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317523.861728:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1767317523.861731:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317523.861735:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317523.861740:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1767317523.861746:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1767317523.861748:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c51179430, osc lock ffff8c3c61004ab0, flags 0x0 00010000:00010000:2.0:1767317523.861757:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861777:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861787:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317523.861797:0:82651:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861807:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.861813:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317523.861825:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000100:00100000:2.0:1767317523.861944:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317523.861968:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291704704:192.168.202.133@tcp:23:lfs.0 00000100:00100000:2.0:1767317523.867006:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291704704:192.168.202.133@tcp:23:lfs.0 00000020:00010000:3.0:1767317523.867650:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.867663:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.867670:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c51179430 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317523.867683:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.867726:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317523.867746:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.867749:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c51179430 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.867772:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.867799:0:82651:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:3.0:1767317523.867815:0:82651:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:3.0:1767317523.867826:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.867837:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.867841:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317523.867847:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1767317523.867927:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000080:00200000:3.0:1767317523.867934:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.867941:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767317523.867943:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317523.867950:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317523.867963:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767317523.867979:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767317523.867983:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x0 00010000:00010000:3.0:1767317523.868006:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.868021:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.868123:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.868133:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.868141:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317523.868154:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000100:00100000:3.0:1767317523.868226:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317523.868249:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291704832:192.168.202.133@tcp:23:lfs.0 00000100:00100000:2.0:1767317523.875574:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291704832:192.168.202.133@tcp:23:lfs.0 00000020:00010000:3.0:1767317523.875805:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.875811:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.875816:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317523.875828:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.875843:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317523.875861:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.875864:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.875925:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.875938:0:82651:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE, rc = 29 00000080:00200080:3.0:1767317523.875968:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317523.875978:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317523.875985:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317523.875993:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317523.876014:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317523.876030:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.876042:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.876050:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.876057:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317523.876060:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:3.0:1767317523.876066:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:3.0:1767317523.876068:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.876075:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.876092:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.876103:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.876106:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.876110:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.876128:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.876131:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x400000400001002 00010000:00010000:3.0:1767317523.876146:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.876166:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.876178:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.876182:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.876189:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.876198:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.876208:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.876211:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.876213:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876216:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876218:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.876220:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.876227:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.876531:0:82651:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767317523.876538:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.876542:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.876545:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317523.876638:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.876644:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767317523.876649:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.876657:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.876660:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.876668:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.876670:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x400000400001002 00010000:00010000:3.0:1767317523.876680:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.876689:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.876697:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.876700:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.876707:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.876716:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.876721:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.876723:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.876725:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876728:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a084f38/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876731:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eacff8 (ffff8c3c5a0845a8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.876733:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.876741:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.876745:0:82651:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 4096] over eof, kms 29, file_size 29. 00000080:00200000:3.0:1767317523.876753:0:82651:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767317523.876760:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317523.876775:0:82651:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317523.876777:0:82651:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767317523.876780:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00000080:00200000:3.0:1767317523.876788:0:82651:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317523.876795:0:82651:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317523.876798:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317523.876810:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317523.876817:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317523.876820:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x40000 00000080:00200000:3.0:1767317523.876826:0:82651:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767317523.876836:0:82651:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317523.876842:0:82651:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317523.876918:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317523.876921:0:82651:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317523.876926:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.876929:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876932:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.876934:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.876936:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.876942:0:82651:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317523.876946:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317523.876968:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bae40 00000008:00100000:3.0:1767317523.877007:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc3100 - object 0x280000400:161 offset 0<>29 00000100:00100000:2.0:1767317523.877185:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317523.877204:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291704960:192.168.202.133@tcp:3:lfs.0 00000008:00010000:2.0:1767317523.883775:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bae40 00000020:00200000:2.0:1767317523.883801:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317523.883808:0:2520:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767317523.883816:0:2520:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317523.883828:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317523.883850:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bae40 00000080:00200000:3.0:1767317523.883899:0:82651:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317523.883926:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.883934:0:82651:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767317523.883939:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.883954:0:82651:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767317523.884113:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317523.884130:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:3.0:1767317523.884138:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317523.884166:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317523.884324:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00000100:00100000:2.0:1767317523.884332:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291704960:192.168.202.133@tcp:3:lfs.0 00010000:00010000:3.0:1767317523.884355:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.884374:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.884477:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.884488:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317523.884492:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:3.0:1767317523.884501:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:3.0:1767317523.884506:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.884516:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.884547:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.884561:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.884565:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.884569:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.884592:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.884596:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x400000400001002 00010000:00010000:3.0:1767317523.884614:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.884625:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.884651:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.884655:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.884664:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.884676:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.884689:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.884694:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.884698:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.884701:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.884706:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.884709:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.884718:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.884744:0:82651:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767317523.884754:0:82651:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1767317523.884765:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767317523.884774:0:82651:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317523.884777:0:82651:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1767317523.884780:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00000080:00200000:3.0:1767317523.884804:0:82651:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317523.884815:0:82651:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1767317523.884820:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:3.0:1767317523.884838:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767317523.884848:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317523.884851:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecbb0, osc lock ffff8c3c60cb50a0, flags 0x40000 00000080:00200000:3.0:1767317523.884862:0:82651:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:3.0:1767317523.884938:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x90:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1767317523.885623:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:3.0:1767317523.885635:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:3.0:1767317523.885647:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:3.0:1767317523.885676:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705088:192.168.202.133@tcp:101:lfs.0 00000100:00100000:3.0:1767317523.886835:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8840 going to sleep for 12 seconds 00000100:00100000:2.0:1767317523.892805:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705088:192.168.202.133@tcp:101:lfs.0 00010000:00010000:2.0:1767317523.892840:0:82651:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.892859:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.892894:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317523.892911:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff8c3c58fc1c00 x1853164291705088/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 568/1440 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317523.892924:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.892941:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767317523.892949:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x90:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1767317523.892987:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d26f 00000080:00010000:2.0:1767317523.892996:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d26f from it ffffa7f7c14f38f8 00010000:00010000:2.0:1767317523.893001:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317523.893206:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317523.893342:0:82651:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767317523.894584:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317523.894593:0:82651:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:2.0:1767317523.894615:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:2.0:1767317523.894622:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:2.0:1767317523.894626:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.894631:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecbb0 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317523.894635:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317523.894638:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecbb0 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317523.894649:0:82651:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767317523.894657:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317523.894756:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fd80 00000008:00100000:2.0:1767317523.894902:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a3aa00 - object 0x2c0000400:193 offset 0<>4096 00000100:00100000:2.0:1767317523.894954:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291705216:192.168.202.133@tcp:4:lfs.0 00000100:00100000:2.0:1767317523.903693:0:2520:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805059 gen 3 00000008:00010000:2.0:1767317523.903763:0:2520:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fd80 00000020:00200000:2.0:1767317523.903772:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317523.903783:0:2520:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317523.903920:0:2520:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fd80 00000100:00100000:2.0:1767317523.903951:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291705216:192.168.202.133@tcp:4:lfs.0 00000080:00200000:3.0:1767317523.904202:0:82651:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767317523.904285:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.904291:0:82651:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767317523.904314:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00200000:3.0:1767317523.904318:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.904329:0:82651:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1767317523.904354:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:3.0:1767317523.904362:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317523.904371:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317523.904380:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317523.904412:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317523.904437:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.904453:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.904463:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317523.904490:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317523.904494:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:3.0:1767317523.904503:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:3.0:1767317523.904507:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.904516:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317523.904542:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.904555:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.904558:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.904563:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.904583:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.904587:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecf30, osc lock ffff8c3c60cb5c80, flags 0x400000400001002 00010000:00010000:3.0:1767317523.904606:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.904616:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.904627:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.904630:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.904637:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.904648:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.904660:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.904665:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.904668:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.904672:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecf30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.904676:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.904679:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecf30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.904687:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.904700:0:82651:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 29, type: SEEK_DATA 00000080:00200000:3.0:1767317523.904706:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.904711:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.904713:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317523.904719:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1767317523.904742:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000080:00200000:3.0:1767317523.904750:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317523.904755:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767317523.904758:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317523.904763:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317523.904769:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767317523.904776:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767317523.904778:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecf30, osc lock ffff8c3c60cb5c80, flags 0x0 00010000:00010000:3.0:1767317523.905349:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905363:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905374:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905396:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905403:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767317523.905417:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.905422:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.905424:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.905427:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecf30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317523.905431:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905439:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317523.905450:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b616c8 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.905452:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecf30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.905461:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.905470:0:82651:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1767317523.905476:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:3.0:1767317523.905481:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317523.905483:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767317523.905486:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317523.905495:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317523.905507:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecf30, osc lock ffff8c3c60cb5c80, flags 0x400000400001002 00010000:00010000:3.0:1767317523.905518:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905527:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.905536:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317523.905538:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.905546:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317523.905555:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317523.905560:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.905563:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.905566:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.905568:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecf30 (ffff8c3c5a0845a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.905571:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42eafb50 (ffff8c3c5a084758/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.905574:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecf30 (ffff8c3c5a084758/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.905580:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.905587:0:82651:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null), rc = 29 00000080:00200080:3.0:1767317523.905595:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317523.921079:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:0.0:1767317523.921109:0:82651:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317523.921121:0:82651:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317523.921158:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317523.921184:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.921203:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.921224:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317523.921234:0:82651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317523.921239:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d261 00000080:00010000:0.0:1767317523.921250:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d261 from it ffffa7f7c14f3cd8 00010000:00010000:0.0:1767317523.921254:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.921265:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.921312:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317523.921333:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.921355:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317523.921361:0:82651:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767317523.921394:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317523.921399:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287430, osc lock ffff8c3c50c8fc80, flags 0x400000400001002 00010000:00010000:0.0:1767317523.921425:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.921437:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317523.921453:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317523.921458:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.921466:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317523.921481:0:82651:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317523.921493:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:0.0:1767317523.921498:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead488 (ffff8c3c5a084b48/0) at cl_lock_release():245 00000020:00010000:0.0:1767317523.921502:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead488 (ffff8c3c5a084b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317523.921505:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287430 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317523.921511:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead488 (ffff8c3c5a084b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317523.921514:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287430 (ffff8c3c5a084b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317523.921528:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317523.921569:0:82651:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2068, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317523.000000000, mtime 1767317523.000000000, ctime 1767317523.000000000 00010000:00010000:0.0:1767317523.921597:0:82651:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.921625:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.921689:0:82651:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.921697:0:82651:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317523.921700:0:82651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d261 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a720b4 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317523.921726:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317523.921743:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291705472/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317523.921774:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705472:192.168.202.133@tcp:36:lfs.0 00000100:00100000:0.0:1767317523.922048:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.926944:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705472:192.168.202.133@tcp:36:lfs.0 00000080:00200000:0.0:1767317523.927009:0:82651:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:0.0:1767317523.927016:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:0.0:1767317523.927038:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:0.0:1767317523.927058:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767317523.927077:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767317523.927083:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287430, osc lock ffff8c3c50c8fc80, flags 0x0 00010000:00010000:0.0:1767317523.927162:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.927176:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317523.927209:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317523.927587:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705600:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317523.927683:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317523.930526:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705600:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317523.930571:0:82651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.930593:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.930612:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317523.930632:0:82651:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.930646:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.930655:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317523.930786:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291705728:192.168.202.133@tcp:10:lfs.0 00000100:00100000:1.0:1767317523.933653:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291705728:192.168.202.133@tcp:10:lfs.0 00000080:00200000:3.0:1767317523.933722:0:82651:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:3.0:1767317523.933732:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c6d17fa88 (ffff8c3c5a084b48/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.933736:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d17fa88 (ffff8c3c5a084b48/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.933742:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287430 (ffff8c3c5a084a28/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317523.933777:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.933793:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317523.933814:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d17fa88 (ffff8c3c5a084b48/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.933818:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287430 (ffff8c3c5a084b48/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.933841:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767317523.933857:0:82651:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 2168, mode 0, uid -1177706702, gid -1, new size 29, atime 1767317523.000000000, mtime 1767317523.000000000, ctime 1767317523.000000000, rc 0 00000080:00200080:3.0:1767317523.933906:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200008:3.0:1767317523.933944:0:82651:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 101f0, mode 0, uid 1511153664, gid -29636, new size 0, atime 1767317521.000000000, mtime 1767317522.000000000, ctime 1767317523.000000000 00000020:00100000:3.0:1767317523.934122:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317523.934132:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0380 x1853164291705984/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317523.934160:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705984:192.168.202.133@tcp:36:lfs.0 00000100:00100000:3.0:1767317523.934399:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c62ac8600 going to sleep for 12 seconds 00000100:00100000:1.0:1767317523.939650:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291705984:192.168.202.133@tcp:36:lfs.0 00000080:00200000:1.0:1767317523.939739:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:1.0:1767317523.939759:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317523.939762:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317523.939773:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1767317523.939791:0:82651:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767317523.939812:0:82651:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767317523.939818:0:82651:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd11d0, flags 0x0 00010000:00010000:1.0:1767317523.939840:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c5075ac00 type 11 mode 2 res 10737419264/162 (0 18446744073709551615) 00010000:00010000:1.0:1767317523.940378:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.940392:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.940405:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317523.940433:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706112:192.168.202.133@tcp:101:lfs.0 00000100:00100000:1.0:1767317523.940529:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:3.0:1767317523.942922:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317523.943155:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317523.943180:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379193600 00000100:00100000:2.0:1767317523.943191:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379193600 00000100:00100000:2.0:1767317523.943314:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9489 00000100:00100000:2.0:1767317523.943323:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379193600:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317523.943343:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317523.943435:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317523.943439:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379193600:12345-192.168.202.133@tcp:104: Request processed in 119us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317523.943446:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9489 00010000:00010000:1.0:1767317523.943518:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.943526:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.943532:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317523.943538:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317523.943558:0:63490:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767317523.943579:0:63490:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767317523.943627:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.943633:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.943669:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.943691:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d268 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x541306ba06a720bb expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.943711:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.943713:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.943715:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317523.943727:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317523.943746:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291706240:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317523.948833:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.949270:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379193728 00000100:00100000:3.0:1767317523.949286:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379193728 00000100:00100000:3.0:1767317523.949408:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9490 00000100:00100000:3.0:1767317523.949422:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379193728:12345-192.168.202.133@tcp:105: 00010000:00010000:3.0:1767317523.949446:0:42090:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949490:0:42090:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949503:0:42090:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949518:0:42090:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949529:0:42090:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949542:0:42090:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.949568:0:42090:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c3c43af0800) 00000100:00100000:3.0:1767317523.949659:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41183:x1853164379193728:12345-192.168.202.133@tcp:105: Request processed in 239us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.949670:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9490 00000100:00100000:0.0:1767317523.953563:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291706240:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317523.953563:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706112:192.168.202.133@tcp:101:lfs.0 00010000:00010000:1.0:1767317523.953603:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.953627:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317523.953642:0:82651:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.953656:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317523.953754:0:82651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317523.954042:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291706368:192.168.202.133@tcp:2:lfs.0 00000100:00100000:1.0:1767317523.956592:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291706368:192.168.202.133@tcp:2:lfs.0 00000020:00010000:3.0:1767317523.956660:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317523.956666:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317523.956673:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767317523.956847:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317523.956928:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767317523.956948:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317523.957012:0:82651:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317523.957040:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767317523.957219:0:82651:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08) current size 29, valid attrs 101f0, mode 0, uid 1511153664, gid -29636, new size 0, atime 1767317521.000000000, mtime 1767317522.000000000, ctime 1767317523.000000000, rc 0 00000080:00200080:0.0:1767317523.957248:0:82651:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=26562a0 00010000:00010000:0.0:1767317523.957323:0:82651:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317523.957343:0:82651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d253 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x541306ba06a7208a expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317523.957367:0:82651:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317523.957379:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317523.957384:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291706624/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317523.957413:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706624:192.168.202.133@tcp:35:lfs.0 00000100:00100000:0.0:1767317523.957564:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1767317523.960554:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317523.960805:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379193856 00000100:00100000:3.0:1767317523.960829:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379193856 00000100:00100000:3.0:1767317523.961256:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9491 00000100:00100000:3.0:1767317523.961270:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379193856:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317523.961308:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317523.961416:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317523.961425:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:51018:x1853164379193856:12345-192.168.202.133@tcp:104: Request processed in 158us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317523.961434:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9491 00010000:00010000:1.0:1767317523.961457:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317523.961466:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.961476:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317523.961483:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.961494:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.961502:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317523.961534:0:60279:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767317523.961586:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.961594:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317523.961630:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317523.961864:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d25a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720a6 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1767317523.961920:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291706752:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317523.961921:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.961923:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317523.961925:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317523.969839:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291706752:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317523.977377:0:82651:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937320 gen 1 00000100:00100000:0.0:1767317523.977420:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706624:192.168.202.133@tcp:35:lfs.0 00000002:00100000:0.0:1767317523.977458:0:82651:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291703808/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317523.977500:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:0.0:1767317523.977515:0:82651:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000002:00010000:0.0:1767317523.977530:0:82651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767317523.977587:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.977597:0:82651:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00010000:00010000:0.0:1767317523.977607:0:82651:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82651 initiator: MDT0 00000100:00100000:0.0:1767317523.977627:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706880:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317523.977726:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317523.981291:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291706880:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317523.981347:0:82651:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981364:0:82651:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317523.981381:0:82651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff8c3c50e9e300 x1853164291706880/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 376/688 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317523.981426:0:82651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317523.981440:0:82651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981457:0:82651:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317523.981464:0:82651:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317523.981485:0:82651:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d284 00000080:00010000:0.0:1767317523.981495:0:82651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d284 from it ffffa7f7c14f3bc8 00010000:00010000:0.0:1767317523.981500:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981509:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981540:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981553:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317523.981562:0:82651:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981612:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981622:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.981646:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 7 restore needed 0 00020000:00200000:0.0:1767317523.981661:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.981664:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317523.981673:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317523.981708:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317523.981722:0:82651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.981731:0:82651:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317523.981739:0:82651:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000379ae429) being reconfigured ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317523.981756:0:82651:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317523.981761:0:82651:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317523.981764:0:82651:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317523.981767:0:82651:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317523.981775:0:82651:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1767317523.981804:0:82651:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317522 1767317521 1767317521 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317521 1767317521 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317523.981837:0:82651:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317523 1767317523 0 by oinfo size 29 blocks 8 [cma]time 1767317523 1767317523 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317523.981852:0:82651:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317522 1767317522 0 by oinfo size 29 blocks 8 [cma]time 1767317523 1767317522 1767317521 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317523.982310:0:82651:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 11 00010000:00010000:0.0:1767317523.982319:0:82651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317523.982328:0:82651:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317523.982372:0:82651:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154002 00000002:00100000:0.0:1767317523.982758:0:82651:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317523.982772:0:82651:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317523.982778:0:82651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291707136/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317523.983496:0:82651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291707136:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317523.983623:0:82651:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317523.991604:0:82651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82651:1853164291707136:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317523.991656:0:82651:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a3b480 x1853164291703168/t8589937314(8589937314) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317540 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317524.075316:0:82653:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317524.075368:0:82653:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.075392:0:82653:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.075410:0:82653:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.075420:0:82653:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.075431:0:82653:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317524.075436:0:82653:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317524.075445:0:82653:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0dd3bf8 00010000:00010000:0.0:1767317524.075462:0:82653:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.075473:0:82653:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.075494:0:82653:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317524.075516:0:82653:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), file ffff8c3c50f1ad80, open_flags 18800, mode 0 opened 0 00000080:00200000:0.0:1767317524.075524:0:82653:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=open 00000002:00010000:0.0:1767317524.075546:0:82653:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767317524.075622:0:82653:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.075806:0:82653:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82653 initiator: MDT0 00000020:00100000:0.0:1767317524.075824:0:82653:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317524.075842:0:82653:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291707392/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317524.075853:0:82653:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82653 initiator: MDT0 00000100:00100000:0.0:1767317524.076469:0:82653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82653:1853164291707392:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317524.077152:0:82653:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317524.082237:0:82653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82653:1853164291707392:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317524.082274:0:82653:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082291:0:82653:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082330:0:82653:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082338:0:82653:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082347:0:82653:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082353:0:82653:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317524.082359:0:82653:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082368:0:82653:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082376:0:82653:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082384:0:82653:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317524.082392:0:82653:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82653 initiator: MDT0 00010000:00010000:0.0:1767317524.082398:0:82653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d28b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82653 initiator: MDT0 00000002:00100000:0.0:1767317524.082427:0:82653:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff8c3c50e9dc00 x1853164291707392/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767317541 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317524.082445:0:82653:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767317524.082631:0:82653:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317524.082658:0:82653:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.084756:0:82653:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.084778:0:82653:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.084799:0:82653:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.084811:0:82653:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317524.084816:0:82653:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317524.084827:0:82653:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0dd3bb0 00010000:00010000:0.0:1767317524.084831:0:82653:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.084839:0:82653:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.084860:0:82653:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317524.084907:0:82653:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200080:0.0:1767317524.084988:0:82653:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) cmd=c0086915 arg=12e63d0 00000100:00100000:0.0:1767317524.085101:0:82653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82653:1853164291707520:192.168.202.133@tcp:34:lfs.0 00000100:00100000:0.0:1767317524.085216:0:82653:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317524.097219:0:82653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82653:1853164291707520:192.168.202.133@tcp:34:lfs.0 00000080:00200008:1.0:1767317524.099369:0:82653:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:2.0:1767317524.142508:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317524.142558:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317524.142581:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317524.142602:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317524.142612:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317524.142625:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317524.142641:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317524.142651:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483b58 00010000:00010000:2.0:1767317524.142656:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317524.142665:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317524.142701:0:82655:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317524.142720:0:82655:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=9 00000080:00200000:2.0:1767317524.142725:0:82655:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317524.142743:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.144977:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82655 initiator: MDT0 00010000:00010000:0.0:1767317524.144999:0:82655:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82655 initiator: MDT0 00010000:00010000:0.0:1767317524.145011:0:82655:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82655 initiator: MDT0 00000100:00100000:0.0:1767317524.145072:0:82655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291707648:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317524.145199:0:82655:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317524.150189:0:82655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291707648:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317524.150225:0:82655:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150246:0:82655:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150255:0:82655:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150270:0:82655:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150283:0:82655:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150305:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150315:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150323:0:82655:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317524.150335:0:82655:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39500 x1853164291707648/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317541 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317524.150370:0:82655:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317524.150386:0:82655:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.150398:0:82655:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317524.150406:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317524.150469:0:82655:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767317524.150473:0:82655:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff8c3c61732a08): rc = 0 00000080:00200000:0.0:1767317524.150492:0:82655:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 11 -> 11 00000080:00010000:0.0:1767317524.150498:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:0.0:1767317524.150513:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317524.150516:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483b20 00010000:00010000:0.0:1767317524.150520:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.150529:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317524.150576:0:82655:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317524.150585:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317524.150616:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.150626:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.150638:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317524.150655:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.150661:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317524.150665:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:0.0:1767317524.150669:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483cb8 00010000:00010000:0.0:1767317524.150672:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.150679:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317524.150749:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317524.150757:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.150765:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150774:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.150781:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.150785:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317524.150787:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317524.150791:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1483bf8 00010000:00010000:0.0:1767317524.150794:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.150801:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.150822:0:82655:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317524.150830:0:82655:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767317524.150837:0:82655:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 44 00000080:00200008:0.0:1767317524.150847:0:82655:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154400 00000002:00010000:0.0:1767317524.150867:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767317524.150973:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82655 initiator: MDT0 00010000:00010000:0.0:1767317524.150980:0:82655:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82655 initiator: MDT0 00000020:00100000:0.0:1767317524.150992:0:82655:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317524.151000:0:82655:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291707904/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317524.151010:0:82655:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82655 initiator: MDT0 00000100:00100000:0.0:1767317524.151037:0:82655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291707904:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317524.151265:0:82655:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317524.155807:0:82655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291707904:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317524.155855:0:82655:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.155867:0:82655:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.156168:0:82655:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.156207:0:82655:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317524.156227:0:82655:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317524.156242:0:82655:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317524.156256:0:82655:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317524.156271:0:82655:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.156284:0:82655:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317524.156291:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317524.156363:0:82655:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767317524.156382:0:82655:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 11 -> 11 00000080:00010000:0.0:1767317524.156388:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d299 00000080:00010000:0.0:1767317524.156397:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d299 from it ffffa7f7c1483bf0 00010000:00010000:0.0:1767317524.156401:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.156412:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317524.156448:0:82655:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1767317524.156611:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffc2fe6614 00000002:00010000:0.0:1767317524.156636:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:0.0:1767317524.161485:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82655 initiator: MDT0 00010000:00010000:0.0:1767317524.161504:0:82655:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82655 initiator: MDT0 00000020:00100000:0.0:1767317524.161518:0:82655:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317524.161531:0:82655:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9fb80 x1853164291708160/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317524.161539:0:82655:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82655 initiator: MDT0 00000100:00100000:0.0:1767317524.161561:0:82655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291708160:192.168.202.133@tcp:101:lfs.0 00000100:00100000:0.0:1767317524.161810:0:82655:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8ba80 going to sleep for 12 seconds 00000100:00100000:0.0:1767317524.168190:0:82655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291708160:192.168.202.133@tcp:101:lfs.0 00010000:00010000:0.0:1767317524.168229:0:82655:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168244:0:82655:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168259:0:82655:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168273:0:82655:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168319:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168327:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168335:0:82655:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317524.168347:0:82655:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff8c3c50e9fb80 x1853164291708160/t8589937323(8589937323) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317524.168361:0:82655:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9fb80 x1853164291708160/t8589937323(8589937323) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317524.168379:0:82655:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168396:0:82655:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767317524.168404:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767317524.168429:0:82655:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9fb80 x1853164291708160/t8589937323(8589937323) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767317524.168438:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d2a0 00000080:00010000:0.0:1767317524.168447:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2a0 from it ffffa7f7c1483cc0 00010000:00010000:0.0:1767317524.168451:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317524.168458:0:82655:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317524.168747:0:82655:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), inode mode 81a4 mask 4 00000080:00200000:0.0:1767317524.168758:0:82655:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), xattr lov 00000080:00200008:0.0:1767317524.168795:0:82655:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317524.168804:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317524.168831:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.168841:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.168854:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317524.168863:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.168869:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317524.168925:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:0.0:1767317524.168930:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483cd8 00010000:00010000:0.0:1767317524.168933:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.168941:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767317524.169020:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=66f4 arg=1 00000080:00200080:3.0:1767317524.250516:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=1 00000080:00200008:3.0:1767317524.250544:0:82655:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317524.250557:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:3.0:1767317524.250603:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317524.250629:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317524.250648:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317524.250665:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317524.250679:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:3.0:1767317524.250684:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:3.0:1767317524.250693:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483cd8 00010000:00010000:3.0:1767317524.250699:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317524.250708:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317524.250751:0:82655:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767317524.250766:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767317524.250783:0:82655:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767317524.250786:0:82655:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767317524.250805:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317524.250817:0:82655:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767317524.250831:0:82655:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767317524.250842:0:82655:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767317524.250844:0:82655:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767317524.250847:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:3.0:1767317524.250857:0:82655:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767317524.250905:0:82655:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767317524.250910:0:82655:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317524.250931:0:82655:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767317524.250950:0:82655:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767317524.250955:0:82655:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ecf30, osc lock ffff8c3c60cb5c80, flags 0x40000 00000080:00200000:3.0:1767317524.250964:0:82655:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:3.0:1767317524.250971:0:82655:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767317524.250975:0:82655:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767317524.250983:0:82655:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c412ec930, osc lock ffff8c3c60cb4980, flags 0x400001002 00010000:00010000:3.0:1767317524.250999:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317524.251010:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767317524.251026:0:82655:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317524.251038:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767317524.251042:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317524.251050:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767317524.251063:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767317524.251072:0:82655:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767317524.251076:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317524.251080:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317524.251083:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ec930 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317524.251087:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317524.251091:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ec930 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317524.251130:0:82655:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767317524.251139:0:82655:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767317524.251209:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767317524.251212:0:82655:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767317524.251226:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:3.0:1767317524.251228:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767317524.251231:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c412ecf30 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767317524.251234:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767317524.251236:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c412ecf30 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767317524.251243:0:82655:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767317524.251250:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767317524.251281:0:51684:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c497bae40 00000008:00100000:3.0:1767317524.252563:0:51684:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c58fc2300 - object 0x280000400:161 offset 0<>29 00000100:00100000:2.0:1767317524.252919:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291708288:192.168.202.133@tcp:3:lfs.0 00000008:00010000:2.0:1767317524.261343:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c497bae40 00000020:00200000:2.0:1767317524.261360:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317524.261370:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767317524.261735:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317524.261754:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317524.261946:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c497bae40 00000100:00100000:2.0:1767317524.261979:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291708288:192.168.202.133@tcp:3:lfs.0 00000080:00200000:0.0:1767317524.262204:0:82655:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767317524.262223:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317524.262230:0:82655:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767317524.262233:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767317524.262245:0:82655:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767317524.262416:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:0.0:1767317524.262470:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=2 00000080:00200008:0.0:1767317524.262479:0:82655:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317524.262489:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317524.262526:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317524.262549:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.262566:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317524.262574:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317524.262584:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317524.262589:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:0.0:1767317524.262598:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483cd8 00010000:00010000:0.0:1767317524.262603:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317524.262612:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317524.262920:0:82655:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:0.0:1767317524.262931:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00020000:00200000:0.0:1767317524.262944:0:82655:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317524.262948:0:82655:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767317524.263033:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317524.263206:0:82655:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767317524.263222:0:82655:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767317524.263231:0:82655:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767317524.263244:0:82655:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767317524.263247:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:0.0:1767317524.263259:0:82655:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767317524.263337:0:82655:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767317524.263343:0:82655:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317524.263367:0:82655:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767317524.263387:0:82655:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767317524.263392:0:82655:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287a30, osc lock ffff8c3c50c8f560, flags 0x40000 00000080:00200000:0.0:1767317524.263401:0:82655:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:0.0:1767317524.263416:0:82655:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767317524.263424:0:82655:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:1.0:1767317524.263944:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767317524.263948:0:82655:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:1.0:1767317524.263958:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317524.263962:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317524.263965:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287a30 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317524.263969:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317524.263971:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287a30 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317524.263982:0:82655:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:1.0:1767317524.263989:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767317524.264009:0:77461:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c5a3199c0 00000008:00100000:1.0:1767317524.264071:0:77461:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c437c2300 - object 0x2c0000400:193 offset 0<>29 00000100:00100000:0.0:1767317524.264350:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291708416:192.168.202.133@tcp:3:lfs.0 00000100:00100000:3.0:1767317524.267435:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317524.267657:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379194624 00000100:00100000:2.0:1767317524.267671:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379194624 00000100:00100000:2.0:1767317524.267744:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9492 00000100:00100000:2.0:1767317524.267757:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36300:x1853164379194624:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317524.267999:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317524.268486:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317524.268497:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36300:x1853164379194624:12345-192.168.202.133@tcp:104: Request processed in 741us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317524.268506:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9492 00010000:00010000:1.0:1767317524.270007:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317524.270024:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.270264:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317524.270283:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.270364:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.270372:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317524.270414:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.270422:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d276 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x541306ba06a720e5 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.270453:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317524.270455:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317524.270457:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317524.270607:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291708544:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:1.0:1767317524.278250:0:2518:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c5a3199c0 00000020:00200000:1.0:1767317524.278268:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767317524.278278:0:2518:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:1.0:1767317524.278289:0:2518:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:1.0:1767317524.278315:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767317524.278337:0:2518:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c5a3199c0 00000100:00100000:1.0:1767317524.278371:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291708416:192.168.202.133@tcp:3:lfs.0 00000080:00200000:2.0:1767317524.279459:0:82655:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767317524.279481:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317524.279511:0:82655:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767317524.279515:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767317524.279529:0:82655:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767317524.279556:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00000080:00200080:2.0:1767317524.279573:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=3 00000080:00200008:2.0:1767317524.279582:0:82655:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317524.279592:0:82655:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:2.0:1767317524.279626:0:82655:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317524.279661:0:82655:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317524.279678:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317524.279687:0:82655:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317524.279699:0:82655:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:2.0:1767317524.279703:0:82655:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:2.0:1767317524.279711:0:82655:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1483cd8 00010000:00010000:2.0:1767317524.279715:0:82655:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317524.279725:0:82655:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317524.279759:0:82655:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767317524.279768:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00020000:00200000:2.0:1767317524.279780:0:82655:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317524.279793:0:82655:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767317524.279809:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317524.279817:0:82655:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767317524.279828:0:82655:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:2.0:1767317524.279836:0:82655:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b11e023e[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767317524.279838:0:82655:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767317524.279841:0:82655:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:2.0:1767317524.279849:0:82655:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767317524.279857:0:82655:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767317524.279861:0:82655:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767317524.279921:0:82655:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767317524.279939:0:82655:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767317524.279944:0:82655:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c511798b0, osc lock ffff8c3c61004260, flags 0x40000 00000080:00200000:2.0:1767317524.279965:0:82655:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767317524.279980:0:82655:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767317524.279988:0:82655:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767317524.280060:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767317524.280063:0:82655:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767317524.280073:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:2.0:1767317524.280077:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317524.280088:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c511798b0 (ffff8c3c547fdd88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317524.280092:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c49b618a8 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317524.280095:0:82655:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c511798b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317524.280102:0:82655:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767317524.280109:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767317524.280132:0:74535:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff8c3c4993fd80 00000008:00100000:2.0:1767317524.280206:0:74535:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff8c3c46a39500 - object 0x280000400:162 offset 0<>29 00000100:00100000:2.0:1767317524.280252:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317524.280275:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291708672:192.168.202.133@tcp:3:lfs.0 00000100:00100000:2.0:1767317524.285699:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317524.285919:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379194752 00000100:00100000:3.0:1767317524.285932:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379194752 00000100:00100000:3.0:1767317524.286008:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9493 00000100:00100000:3.0:1767317524.286019:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379194752:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317524.286050:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317524.286157:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317524.286165:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36300:x1853164379194752:12345-192.168.202.133@tcp:104: Request processed in 147us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317524.286173:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9493 00010000:00010000:1.0:1767317524.286385:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317524.286395:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.286426:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317524.286432:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400020000 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.286488:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400020020 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.286496:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317524.286519:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400020020 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.286527:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d27d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400020020 nid: local remote: 0x541306ba06a720f3 expref: -99 pid: 82651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317524.286552:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317524.286554:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317524.286556:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317524.286575:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291708800:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317524.293763:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291708544:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317524.305500:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291708800:192.168.202.133@tcp:103:ldlm_bl.0 00000008:00010000:2.0:1767317524.307604:0:2519:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff8c3c4993fd80 00000020:00200000:2.0:1767317524.307619:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767317524.308202:0:2519:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767317524.308213:0:2519:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767317524.308228:0:2519:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767317524.308325:0:2519:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff8c3c4993fd80 00000100:00100000:2.0:1767317524.308357:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291708672:192.168.202.133@tcp:3:lfs.0 00000080:00200000:1.0:1767317524.308453:0:82655:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767317524.308470:0:82655:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317524.308478:0:82655:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:1.0:1767317524.308481:0:82655:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317524.308493:0:82655:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:1.0:1767317524.308519:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=400866b1 arg=0 00010000:00010000:2.0:1767317524.321444:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:1.0:1767317524.330848:0:82655:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) cmd=c00c66f3 arg=7fffc2fe6624 00010000:00010000:1.0:1767317524.330899:0:82655:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317524.330986:0:82655:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317524.330995:0:82655:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317524.331023:0:82655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291708928:192.168.202.133@tcp:103:lfs.0 00000100:00100000:1.0:1767317524.332195:0:82655:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317524.334468:0:82655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291708928:192.168.202.133@tcp:103:lfs.0 00010000:00010000:1.0:1767317524.334503:0:82655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2a0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x541306ba06a7216a expref: -99 pid: 82655 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317524.335334:0:82655:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9fb80 x1853164291708160/t8589937323(8589937323) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317524.335351:0:82655:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317524.335357:0:82655:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291709184/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317524.335385:0:82655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291709184:192.168.202.133@tcp:35:lfs.0 00000100:00100000:1.0:1767317524.335489:0:82655:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c43907e40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317524.364974:0:82655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job lfs:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:82655:1853164291709184:192.168.202.133@tcp:35:lfs.0 00000002:00100000:1.0:1767317524.365023:0:82655:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9fb80 x1853164291708160/t8589937323(8589937323) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317524.365107:0:82655:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), flags 154000 00010000:00010000:1.0:1767317524.365151:0:82655:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317525.347613:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317526.369472:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317527.393515:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317528.098080:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291709312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.098180:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.098204:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.098230:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1767317528.098236:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.098254:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.107322:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291709312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.107346:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.107360:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.107390:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317528.107401:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291709696:192.168.202.133@tcp:400:kworker.0 00010000:00010000:0.0:1767317528.417052:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317529.442753:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317530.466093:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1767317530.495232:0:83210:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test complete, duration 1981 sec =========== 20:32:09 (1767317529) 00010000:00010000:1.0:1767317531.489172:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317532.513653:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767317532.801811:0:83356:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-flr: start cleanup 20:32:10 (1767317530) === 00000080:00200000:0.0:1767317532.936694:0:10344:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317532.936729:0:10344:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317532.936748:0:10344:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.936764:0:10344:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317532.936771:0:10344:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317532.936780:0:10344:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317532.936784:0:10344:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317532.936799:0:10344:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0da3bb0 00010000:00010000:0.0:1767317532.936803:0:10344:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.936812:0:10344:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317532.936829:0:10344:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317532.936838:0:10344:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200008:0.0:1767317532.936855:0:10344:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 2047, flags 0, foreign 0 00000002:00010000:0.0:1767317532.937125:0:10344:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317532.937133:0:10344:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.937141:0:10344:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317532.938245:0:10344:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:10344:1853164291709952:192.168.202.133@tcp:37:bash.0 00000100:00100000:1.0:1767317532.938415:0:10344:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1767317532.967536:0:10344:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937324 gen 1 00000100:00100000:2.0:1767317532.967565:0:10344:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767317532.967583:0:10344:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job bash:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:10344:1853164291709952:192.168.202.133@tcp:37:bash.0 00010000:00010000:2.0:1767317532.969266:0:10344:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317532.969291:0:10344:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317532.969334:0:10344:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317532.969364:0:10344:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317532.969386:0:10344:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317532.969401:0:10344:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317532.969410:0:10344:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317532.969420:0:10344:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317532.969437:0:10344:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317532.969444:0:10344:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c0da3cd8 00010000:00010000:2.0:1767317532.969448:0:10344:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317532.969456:0:10344:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317532.970176:0:10344:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1767317532.970320:0:10344:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:2.0:1767317532.970342:0:10344:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags 304000 00000080:00200000:0.0:1767317532.992270:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317532.992314:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317532.992342:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.992362:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317532.992370:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317532.992382:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317532.992387:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317532.992396:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317532.992407:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.992417:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317532.992438:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317532.992453:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317532.992458:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317532.992476:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317532.992544:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317532.992553:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317532.992564:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317532.992599:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710080:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317532.992750:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317532.997763:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710080:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317532.997795:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997821:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997831:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997863:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997906:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997923:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997932:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997940:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317532.997955:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ce00 x1853164291710080/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317549 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317532.997969:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317532.997981:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677441/1 (0 0) 00000002:00010000:0.0:1767317532.998001:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317532.998058:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317532.998066:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317532.998075:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317532.998111:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710208:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317532.998231:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.005732:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710208:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.005767:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005781:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005796:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005808:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005822:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005829:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005837:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.005849:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291710208/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317549 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.005863:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.005945:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677441/1 (0 0) 00000080:00200000:0.0:1767317533.005972:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.006017:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00200000:0.0:1767317533.006025:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.006033:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for remote lock 0x73c3d5cb1442d2ae 00000080:00010000:0.0:1767317533.006039:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2a7 00000080:00010000:0.0:1767317533.006052:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00010000:0.0:1767317533.006057:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2a7 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317533.006061:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006070:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317533.006088:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d2ae from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317533.006091:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006097:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317533.006131:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317533.006140:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448),name=d0a.sanity-flr 00000002:00010000:0.0:1767317533.006169:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.006179:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006201:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.006209:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.006225:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00010000:0.0:1767317533.006229:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2ae 00000080:00010000:0.0:1767317533.006233:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ae from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317533.006236:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006244:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.006398:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.006408:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.006418:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006428:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.006434:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.006438:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.006441:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317533.006445:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317533.006448:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.006466:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.006475:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.006483:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0a.sanity-flr, flags=266 00000080:00200000:0.0:1767317533.006488:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 44 00000080:00200008:0.0:1767317533.006499:0:83367:0:(file.c:1001:ll_file_open()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), flags 704400 00000002:00010000:0.0:1767317533.006519:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317533.006587:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.006594:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317533.006607:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317533.006614:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291710464/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317533.006624:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.006649:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710464:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.006943:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.011435:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710464:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.011466:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011481:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011512:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011521:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011530:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011537:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.011542:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011550:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011557:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011565:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317533.011573:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.011581:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317533.011614:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c50e9ca80 x1853164291710464/t4294976277(4294976277) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317533.011628:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291710464/t4294976277(4294976277) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317533.011644:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.011678:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767317533.011716:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ca80 x1853164291710464/t4294976277(4294976277) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317533.011801:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317533.011810:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448),name=d0a.sanity-flr 00000002:00010000:0.0:1767317533.011839:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.011854:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.011867:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.012145:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.012153:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00010000:0.0:1767317533.012157:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2ae 00000080:00010000:0.0:1767317533.012164:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ae from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317533.012167:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.012315:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.012427:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317533.012448:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x240000401:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.012458:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.012468:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317533.014181:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710592:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317533.014329:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.030588:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710592:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317533.035248:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.035276:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317533.035449:0:83367:0:(file.c:424:ll_file_release()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), flags 704000 00000002:00100000:0.0:1767317533.035546:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9ca80 x1853164291710464/t4294976277(4294976277) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317533.035560:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317533.035567:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ce00 x1853164291710848/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317533.035595:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710848:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317533.035732:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:2.0:1767317533.044140:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291710848:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317533.044194:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9ca80 x1853164291710464/t4294976277(4294976277) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317533.044316:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317533.044344:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317533.044367:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.044384:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317533.044394:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317533.044402:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317533.044406:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:2.0:1767317533.044415:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c1fbf8 00010000:00010000:2.0:1767317533.044420:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.044438:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317533.044457:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317533.044465:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0a.sanity-flr, flags=266 00000080:00200000:2.0:1767317533.044475:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 44 00000080:00200008:2.0:1767317533.044485:0:83367:0:(file.c:1001:ll_file_open()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), flags 704400 00000002:00010000:2.0:1767317533.044503:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1767317533.044575:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317533.044583:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:2.0:1767317533.044597:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317533.044605:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39500 x1853164291711104/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317533.044615:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317533.044638:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711104:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317533.044921:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f540 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.057009:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711104:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.057074:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057087:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057125:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057137:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.057155:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c46a39500 x1853164291711104/t4294976279(4294976279) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317533.057182:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39500 x1853164291711104/t4294976279(4294976279) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.057196:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057210:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677441/1 (0 0) 00000080:00200000:3.0:1767317533.057227:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317533.057256:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1767317533.057261:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2bc 00000080:00010000:3.0:1767317533.057271:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2bc from it ffffa7f7c1c1fbd0 00010000:00010000:3.0:1767317533.057276:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057286:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.057322:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39500 x1853164291711104/t4294976279(4294976279) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767317533.057425:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317533.057434:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448),name=d0a.sanity-flr 00000002:00010000:3.0:1767317533.057463:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.057474:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057486:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.057493:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317533.057499:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00010000:3.0:1767317533.057504:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2ae 00000080:00010000:3.0:1767317533.057508:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ae from it ffffa7f7c1c1fcd8 00010000:00010000:3.0:1767317533.057512:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.057518:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.057608:0:83367:0:(llite_lib.c:2766:ll_statfs()) VFS Op:sb=lustre (ffff8c3c49ba6000) d0a.sanity-flr proj=0 00000080:00000004:3.0:1767317533.057614:0:83367:0:(obd_class.h:1083:obd_statfs()) lustre-clilmv-ffff8c3c49ba6000: age 2206, max_age 2436 00800000:00000004:3.0:1767317533.057629:0:83367:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0000-mdc-ffff8c3c49ba6000: age 2206, max_age 2436 00000100:00100000:3.0:1767317533.057679:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711232:192.168.202.133@tcp:41:rm.0 00000100:00100000:3.0:1767317533.057806:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb3c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.063504:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711232:192.168.202.133@tcp:41:rm.0 00800000:00000004:3.0:1767317533.063541:0:83367:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0000-mdc-ffff8c3c49ba6000: update ffff8c3c50b9b520 cache blocks 1798795/1916558 objects 523360/524057 00000080:00000004:3.0:1767317533.063559:0:83367:0:(obd_class.h:1109:obd_statfs()) lustre-clilmv-ffff8c3c49ba6000: update ffff8c3c43124df8 cache blocks 1798795/1916558 objects 523360/524057 00000080:00000004:3.0:1767317533.063565:0:83367:0:(llite_lib.c:2629:ll_statfs_internal()) MDC blocks 1798795/1916558 objects 523360/524057 00000080:00200000:3.0:1767317533.063604:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448) pos/size0/4096 32bit_api 0 00000080:00200000:3.0:1767317533.063645:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:3.0:1767317533.063672:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 1 00000080:00200000:3.0:1767317533.063696:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), flags=0 00000080:00200000:3.0:1767317533.064854:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), intent=getattr 00000002:00010000:2.0:1767317533.065796:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr-2,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317533.065931:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317533.065944:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317533.065973:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317533.066010:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711360:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317533.068258:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f540 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.075340:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711360:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.075379:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075408:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075417:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075432:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075445:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075459:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075467:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.075494:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.075507:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3bb80 x1853164291711360/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/1656 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.075522:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1072 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.075540:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.075553:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677441/4 (0 0) 00000080:00200000:3.0:1767317533.075563:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317533.075607:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x4:0x0](ffff8c3c597dd348) 00000080:00200000:3.0:1767317533.075820:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x4:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:3.0:1767317533.075828:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x4:0x0](ffff8c3c597dd348) for lock 0x73c3d5cb1442d2c3 00000080:00010000:3.0:1767317533.075842:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x4:0x0](ffff8c3c597dd348) 00000080:00010000:3.0:1767317533.075846:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2c3 from it ffffa7f7c1c1fdf8 00010000:00010000:3.0:1767317533.075850:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.075860:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317533.075943:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 3 00000080:00200000:3.0:1767317533.075954:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff8c3c61737448) 00010000:00010000:3.0:1767317533.076001:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.078465:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317533.078502:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x4:0x0]: losing layout lock 00010000:00010000:3.0:1767317533.078558:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.078565:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.078572:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317533.078576:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d2c3 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a721ef expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.078595:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d2ae lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721b0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317533.078614:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317533.078629:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc2300 x1853164291711616/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317533.078661:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711616:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317533.078794:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317533.099564:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711616:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317533.099634:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317533.099648:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x4:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 10 00020000:00200000:2.0:1767317533.099652:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317533.099660:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317533.099697:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317533.100160:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x4:0x0](ffff8c3c597dd348) 00000080:00200000:2.0:1767317533.101864:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 1 00000080:00200000:2.0:1767317533.102022:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), flags=0 00000080:00200000:2.0:1767317533.102029:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), intent=getattr 00000002:00010000:2.0:1767317533.102577:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317533.102666:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317533.102680:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317533.102692:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317533.102988:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711744:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317533.103409:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f540 going to sleep for 12 seconds 00000100:00100000:2.0:1767317533.117036:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291711744:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317533.117589:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117616:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117626:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117641:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117655:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117670:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117678:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.117686:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317533.117699:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38a80 x1853164291711744/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/720 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317533.117725:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317533.117751:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.117765:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677441/2 (0 0) 00000080:00200000:2.0:1767317533.117775:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317533.117828:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x2:0x0](ffff8c3c4857ec08) 00000080:00200000:2.0:1767317533.117968:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x2:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:2.0:1767317533.117978:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x2:0x0](ffff8c3c4857ec08) for lock 0x73c3d5cb1442d2ca 00000080:00010000:2.0:1767317533.117991:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x2:0x0](ffff8c3c4857ec08) 00000080:00010000:2.0:1767317533.117995:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ca from it ffffa7f7c1c1fdf8 00010000:00010000:2.0:1767317533.117998:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.118009:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317533.120279:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 3 00000080:00200000:2.0:1767317533.120302:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff8c3c61737448) 00010000:00010000:2.0:1767317533.120375:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317533.120402:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x2:0x0]: losing layout lock 00010000:00010000:2.0:1767317533.120465:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 1/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.120472:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317533.120475:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d2ca lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72227 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767317533.120522:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317533.120538:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38a80 x1853164291712000/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317533.120568:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712000:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317533.120719:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f540 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.128088:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712000:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317533.128246:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x2:0x0] ignore/verify layout 1/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767317533.128266:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317533.128301:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317533.128311:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x2:0x0](ffff8c3c4857ec08) 00000080:00200000:3.0:1767317533.128683:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 1 00000080:00200000:3.0:1767317533.128784:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), flags=0 00000080:00200000:3.0:1767317533.128792:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff8c3c61737448), intent=getattr 00000002:00010000:3.0:1767317533.128827:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.128940:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.128953:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.128965:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317533.128997:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712128:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317533.129195:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebe40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.137004:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712128:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.137043:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137084:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137095:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137110:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137123:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137149:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137158:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.137166:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.137180:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc0380 x1853164291712128/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/2280 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.137191:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1696 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.137209:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.137233:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677441/3 (0 0) 00000080:00200000:3.0:1767317533.137242:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317533.137289:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x3:0x0](ffff8c3c597ddb88) 00000080:00200000:3.0:1767317533.137466:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x3:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:3.0:1767317533.137473:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x3:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d2d1 00000080:00010000:3.0:1767317533.137499:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x3:0x0](ffff8c3c597ddb88) 00000080:00010000:3.0:1767317533.137503:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2d1 from it ffffa7f7c1c1fdf8 00010000:00010000:3.0:1767317533.137507:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.137528:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317533.137565:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448), inode mode 41ed mask 3 00000080:00200000:3.0:1767317533.137574:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff8c3c61737448) 00010000:00010000:3.0:1767317533.137617:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317533.137633:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x3:0x0]: losing layout lock 00010000:00010000:3.0:1767317533.137675:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317533.137683:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317533.137686:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7225f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767317533.137714:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317533.137720:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0380 x1853164291712384/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317533.137744:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712384:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317533.137841:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb180 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.151789:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712384:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317533.151868:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317533.151909:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x3:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 16 00020000:00200000:3.0:1767317533.151913:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317533.151922:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317533.151987:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317533.151996:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x3:0x0](ffff8c3c597ddb88) 00000080:00200008:3.0:1767317533.152207:0:83367:0:(file.c:424:ll_file_release()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff8c3c61737448), flags 704000 00010000:00010000:3.0:1767317533.152253:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.152317:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317533.152339:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.152351:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.152362:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.152370:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317533.152376:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317533.152381:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:3.0:1767317533.152389:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c1fc10 00010000:00010000:3.0:1767317533.152394:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.152401:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.152421:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317533.152441:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:3.0:1767317533.152447:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317533.152464:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.152524:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.152539:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.152552:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317533.152578:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712512:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317533.152709:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebe40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.160209:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712512:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.160255:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160277:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160286:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160301:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160314:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160329:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160338:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160362:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.160377:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3b80 x1853164291712512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.160393:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160407:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160421:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160431:0:83367:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160438:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160445:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.160474:0:83367:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:3.0:1767317533.160494:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.160556:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.160564:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.160582:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317533.160608:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712640:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317533.160711:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb180 going to sleep for 12 seconds 00010000:00010000:2.0:1767317533.161139:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767317533.161151:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161163:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c91400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:2.0:1767317533.161169:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161178:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161188:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161225:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161270:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161276:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317533.161304:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161319:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d2d8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72297 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.161335:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317533.161337:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317533.161339:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317533.161349:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317533.161366:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291712768:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317533.168362:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291712768:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.170787:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291712640:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.170822:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170839:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170853:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170904:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170932:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170942:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170950:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.170964:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3800 x1853164291712640/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.170979:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.170996:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677441/1 (0 0) 00000080:00200000:0.0:1767317533.171021:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.171065:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00200000:0.0:1767317533.171069:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x240000401:0x1:0x0](ffff8c3c61737448): rc = 0 00000080:00010000:0.0:1767317533.171077:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for remote lock 0x73c3d5cb1442d2df 00000080:00010000:0.0:1767317533.171084:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d2a7 00000080:00010000:0.0:1767317533.171096:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00010000:0.0:1767317533.171101:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2a7 from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317533.171106:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171279:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317533.171295:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d2df from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317533.171300:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171307:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.171332:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.171358:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.171370:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171382:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.171389:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.171396:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.171400:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d149 00000080:00010000:0.0:1767317533.171404:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d149 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317533.171407:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171414:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.171434:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317533.171443:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317533.171468:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171525:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171532:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.171794:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2a7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721a2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171829:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.171846:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.171917:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a39500 x1853164291711104/t4294976279(4294976279) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317533.171929:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317533.171936:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ea00 x1853164291713152/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317533.171959:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291713152:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317533.172271:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.173719:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291712896:192.168.202.133@tcp:103:rm.0 00000100:00100000:2.0:1767317533.192862:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291713152:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317533.192953:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a39500 x1853164291711104/t4294976279(4294976279) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767317533.193063:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.193074:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 1/0,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.193081:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317533.193085:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d2df lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a722a5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.193101:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d2bc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a721cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317533.193473:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317533.193483:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39500 x1853164291713408/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317533.193539:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291713408:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317533.193652:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.193947:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291712896:192.168.202.133@tcp:103:rm.0 00000100:00100000:3.0:1767317533.199911:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317533.200576:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379197568 00000100:00100000:2.0:1767317533.200592:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379197568 00000100:00100000:2.0:1767317533.200841:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9494 00000100:00100000:2.0:1767317533.200856:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379197568:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317533.200909:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.201037:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317533.201045:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379197568:12345-192.168.202.133@tcp:104: Request processed in 192us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317533.201053:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9494 00010000:00010000:0.0:1767317533.201156:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317533.201165:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201175:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c821ce600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.201182:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201191:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201200:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201383:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201391:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.201423:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201432:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821ce600/0x73c3d5cb1442d149 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a71d42 expref: -99 pid: 82640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.201452:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.201454:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.201455:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317533.201468:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317533.201499:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291713536:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.213685:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291713536:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317533.217679:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317533.217727:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291713664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317533.218414:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291713792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317533.218463:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317533.218469:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291713920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317533.229044:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291713408:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.229118:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x1:0x0](ffff8c3c61737448) 00000080:00200000:0.0:1767317533.229230:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.229260:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.229350:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.229363:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.229375:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.229402:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714048:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.229507:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317533.232284:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8c3c49ba6000: committing for last_committed 17179876021 gen 2 00000100:00100000:2.0:1767317533.232331:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291713920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317533.232346:0:2519:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8c3c49ba6000: committing for last_committed 25769805060 gen 3 00000100:00100000:2.0:1767317533.232354:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291713792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317533.232366:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291713664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317533.237222:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714048:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.237259:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237273:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237287:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237298:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237345:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237354:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237362:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.237374:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291714048/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.237388:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237405:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317533.237414:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.237450:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.237457:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d2e6 00000080:00010000:0.0:1767317533.237463:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.237467:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2e6 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317533.237470:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.237479:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.237511:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.237553:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317533.237559:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317533.237587:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.237641:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.237649:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.237661:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.237687:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714176:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.237795:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.242079:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714176:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.242112:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242156:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242165:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242180:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242194:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242208:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242228:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242236:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.242250:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291714176/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.242267:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242280:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/3 (0 0) 00000080:00200000:1.0:1767317533.242289:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.242344:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00200000:1.0:1767317533.242354:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00010000:1.0:1767317533.242363:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d2ed 00000080:00010000:1.0:1767317533.242379:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.242383:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ed from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317533.242386:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242396:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317533.242450:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.242458:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148),name=d0d.sanity-flr 00000002:00010000:1.0:1767317533.242488:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.242497:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242509:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.242516:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.242522:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.242525:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d2ed 00000080:00010000:1.0:1767317533.242529:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ed from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317533.242532:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242538:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.242617:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.242627:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.242636:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242645:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.242651:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.242655:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.242657:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d2e6 00000080:00010000:1.0:1767317533.242661:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2e6 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317533.242664:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.242672:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.242680:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.242690:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0d.sanity-flr, flags=266 00000080:00200000:1.0:1767317533.242696:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 44 00000080:00200008:1.0:1767317533.242720:0:83367:0:(file.c:1001:ll_file_open()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), flags 704400 00000002:00010000:1.0:1767317533.242739:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317533.242799:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.242806:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317533.242831:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317533.242839:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291714432/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317533.242849:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.242909:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714432:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.243155:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.251066:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714432:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.251098:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251126:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251135:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251143:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251152:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251159:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.251164:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251172:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251206:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251225:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317533.251233:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.251240:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317533.251263:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1880 x1853164291714432/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317533.251277:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1880 x1853164291714432/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.251293:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.251327:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000002:00100000:1.0:1767317533.251352:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1880 x1853164291714432/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317533.251443:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.251452:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148),name=d0d.sanity-flr 00000002:00010000:1.0:1767317533.251480:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.251499:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.251513:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.251521:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.251534:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.251538:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d2ed 00000080:00010000:1.0:1767317533.251546:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ed from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317533.251550:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.251558:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.251598:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767317533.251613:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000402:0x3:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.251619:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.251628:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.252366:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714560:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.254578:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.269506:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714560:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.270522:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.270546:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317533.270985:0:83367:0:(file.c:424:ll_file_release()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), flags 704000 00000002:00100000:1.0:1767317533.271080:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1880 x1853164291714432/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.271166:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.271174:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291714816/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.271206:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714816:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.271335:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.284498:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291714816:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.284552:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1880 x1853164291714432/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.284671:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.284696:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.284823:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.284839:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.284848:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.284855:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.284860:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d2e6 00000080:00010000:1.0:1767317533.285084:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2e6 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317533.285092:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.285417:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.285462:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.285472:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0d.sanity-flr, flags=266 00000080:00200000:1.0:1767317533.285481:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 44 00000080:00200008:1.0:1767317533.285491:0:83367:0:(file.c:1001:ll_file_open()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), flags 704400 00000002:00010000:1.0:1767317533.285514:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317533.285580:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.285601:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317533.285615:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317533.285625:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291715072/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317533.285635:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.285660:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715072:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.286684:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.303615:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715072:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.303664:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.303677:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.303692:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.303726:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.303746:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1500 x1853164291715072/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317533.303760:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291715072/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.303773:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.303786:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935618/3 (0 0) 00000080:00200000:1.0:1767317533.303794:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.303820:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00010000:1.0:1767317533.303826:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d2fb 00000080:00010000:1.0:1767317533.303835:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2fb from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317533.303840:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.303850:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.304547:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291715072/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317533.304669:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.304679:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148),name=d0d.sanity-flr 00000002:00010000:1.0:1767317533.304709:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.304731:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.304746:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.304755:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.304763:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.304767:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d2ed 00000080:00010000:1.0:1767317533.304774:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2ed from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317533.304778:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.304786:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.304834:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317533.305442:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317533.305488:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.305513:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), flags=0 00000080:00200000:0.0:1767317533.305518:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), intent=getattr 00000002:00010000:0.0:1767317533.305540:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr-3,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.305697:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.305706:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.305718:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.305750:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715200:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.306096:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.312528:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715200:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.312560:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312599:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312606:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312617:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312626:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312637:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312644:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.312649:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.312656:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291715200/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/2280 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.312664:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1696 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.312696:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.312707:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/9 (0 0) 00000080:00200000:0.0:1767317533.312716:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.312757:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x9:0x0](ffff8c3c61737448) 00000080:00200000:2.0:1767317533.313086:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x9:0x0], updating i_size 0 00000080:00200000:2.0:1767317533.313142:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x9:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:2.0:1767317533.313148:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x9:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d302 00000080:00010000:2.0:1767317533.313161:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x9:0x0](ffff8c3c61737448) 00000080:00010000:2.0:1767317533.313163:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d302 from it ffffa7f7c1c1fdf8 00010000:00010000:2.0:1767317533.313174:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.313184:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317533.313261:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 3 00000080:00200000:2.0:1767317533.313272:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff8c3c61721148) 00010000:00010000:2.0:1767317533.313329:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.313352:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.313430:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317533.313443:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x9:0x0]: losing layout lock 00010000:00010000:2.0:1767317533.313485:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.313492:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 1/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.313498:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317533.313501:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7233f expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317533.313520:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d2ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72300 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317533.313553:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317533.313562:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b800 x1853164291715456/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317533.313590:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715456:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317533.313697:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.320649:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715456:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.320728:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317533.320743:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x9:0x0]: flr state: 1, move mirror from 4 to 4, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767317533.320759:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317533.320767:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[4] flags 0x10 00000080:00200000:0.0:1767317533.320805:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317533.320815:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x9:0x0](ffff8c3c61737448) 00000080:00200000:0.0:1767317533.321088:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.321109:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), flags=0 00000080:00200000:0.0:1767317533.321180:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), intent=getattr 00000002:00010000:0.0:1767317533.321224:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.321291:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.321300:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.321308:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.321577:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715584:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.321748:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.326803:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715584:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.326839:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327193:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327206:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327232:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327247:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327263:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327272:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.327281:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.327295:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9c700 x1853164291715584/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.327308:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.327346:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.327359:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/7 (0 0) 00000080:00200000:0.0:1767317533.327367:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.327416:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x7:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317533.327507:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7:0x0], updating i_size 0 00000080:00200000:0.0:1767317533.327536:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x7:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317533.327544:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d309 00000080:00010000:0.0:1767317533.327556:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317533.327560:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d309 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317533.327563:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.327572:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317533.327611:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 3 00000080:00200000:0.0:1767317533.327621:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff8c3c61721148) 00010000:00010000:0.0:1767317533.327663:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317533.327681:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1767317533.327728:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.327735:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.327738:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d309 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72377 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317533.327777:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317533.327785:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c700 x1853164291715840/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317533.327815:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715840:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317533.328365:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.334335:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715840:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.334418:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317533.334435:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x7:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317533.334440:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317533.334449:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317533.334489:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317533.334498:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x7:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317533.335601:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.335628:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), flags=0 00000080:00200000:0.0:1767317533.335634:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff8c3c61721148), intent=getattr 00000002:00010000:0.0:1767317533.335671:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.335831:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.335843:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.335853:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.336139:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715968:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.336406:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.341661:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291715968:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.341775:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.341809:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.341819:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.341833:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.341847:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.341862:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.342142:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.342152:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.342167:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d180 x1853164291715968/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/928 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.342294:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.342329:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.342342:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/4 (0 0) 00000080:00200000:0.0:1767317533.342351:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.342395:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x4:0x0](ffff8c3c61737448) 00000080:00200000:0.0:1767317533.342483:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x4:0x0], updating i_size 0 00000080:00200000:0.0:1767317533.342514:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x4:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767317533.342521:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x4:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d310 00000080:00010000:0.0:1767317533.342533:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x4:0x0](ffff8c3c61737448) 00000080:00010000:0.0:1767317533.342537:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d310 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317533.342540:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.342549:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317533.342590:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148), inode mode 41ed mask 3 00000080:00200000:0.0:1767317533.342600:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff8c3c61721148) 00010000:00010000:0.0:1767317533.342641:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317533.342659:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x4:0x0]: losing layout lock 00010000:00010000:0.0:1767317533.342808:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.342816:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.342819:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d310 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a723af expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317533.342859:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317533.342867:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d180 x1853164291716224/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317533.343429:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716224:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317533.343544:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.350615:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716224:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.350692:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317533.350800:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x4:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317533.350805:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317533.350813:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317533.350849:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317533.350860:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x4:0x0](ffff8c3c61737448) 00000080:00200008:1.0:1767317533.351973:0:83367:0:(file.c:424:ll_file_release()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff8c3c61721148), flags 704000 00010000:00010000:1.0:1767317533.352016:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.352078:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.352100:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.352110:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.352120:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.352128:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.352155:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.352160:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d2e6 00000080:00010000:1.0:1767317533.352458:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2e6 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317533.352464:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.352473:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.352493:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.352512:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:1.0:1767317533.352517:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317533.352533:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.352595:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.352603:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.352615:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.352645:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716352:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.352837:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.359505:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716352:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.359539:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359562:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359590:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359605:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359618:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359632:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359640:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359648:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.359662:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1880 x1853164291716352/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.359676:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359687:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/3 (0 0) 00000080:00200000:1.0:1767317533.359695:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.359725:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00200000:1.0:1767317533.359729:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000402:0x3:0x0](ffff8c3c61721148): rc = 0 00000080:00010000:1.0:1767317533.359735:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d317 00000080:00010000:1.0:1767317533.359757:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.359761:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d317 from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317533.359764:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359773:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.359810:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.359834:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.359843:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359854:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.359860:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.359865:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.359898:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d2e6 00000080:00010000:1.0:1767317533.359903:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d2e6 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317533.359907:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359914:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.359923:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317533.359932:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317533.359957:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.359995:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.360009:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.360055:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1500 x1853164291715072/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.360068:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.360073:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291716608/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.360097:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716608:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.360190:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.368276:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716608:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.368326:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1500 x1853164291715072/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317533.368437:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.368451:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.368460:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.368466:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317533.368490:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a723e7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.368505:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d2fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7231c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.368520:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d2e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a722e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317533.368545:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317533.368552:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291716864/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317533.368580:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716864:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317533.368684:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.375367:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716864:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317533.375430:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8c3c61721148) 00000080:00200000:1.0:1767317533.375526:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.375553:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.375634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.375645:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.375656:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.375680:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716992:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.375794:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.381479:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291716992:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.381515:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381530:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381546:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381559:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381573:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381581:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381590:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.381603:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291716992/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.381620:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381635:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317533.381644:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.381699:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317533.381707:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d31e 00000080:00010000:1.0:1767317533.381714:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.381717:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d31e from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317533.381720:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.381729:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.381760:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.381788:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317533.381794:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317533.381823:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0h.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.381902:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.381910:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.381935:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.381965:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717120:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.382072:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.390613:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717120:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.390647:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390674:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390715:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390730:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390744:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390759:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390768:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390776:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.390788:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291717120/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.390805:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.390817:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/28 (0 0) 00000080:00200000:1.0:1767317533.390824:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.390935:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148) 00000002:00010000:1.0:1767317533.390971:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.391035:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.391050:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.391060:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.391087:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717248:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.391194:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.395947:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717248:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.395981:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 4/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.395996:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 4/1,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396010:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396021:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396035:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396045:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396053:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.396088:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3480 x1853164291717248/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.396105:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396120:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/4 (0 0) 00010000:00010000:1.0:1767317533.396127:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.396135:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.396184:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.396259:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.396267:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.396277:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.396299:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717376:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.396400:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.400553:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717376:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.400587:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400629:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400642:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400656:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400670:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400679:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400687:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.400710:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3480 x1853164291717376/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.400728:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400744:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/2 (0 0) 00010000:00010000:1.0:1767317533.400753:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400761:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.400817:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 8192 00000080:00010000:1.0:1767317533.400832:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d325 00000080:00010000:1.0:1767317533.400849:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.400853:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d325 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317533.400858:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.400866:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317533.401389:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.401398:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148),name=d0h.sanity-flr 00000002:00010000:1.0:1767317533.401431:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401443:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401454:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.401462:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401468:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401474:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401482:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401496:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.401505:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401511:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401518:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401524:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401530:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.401539:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.401544:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.401548:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d325 00000080:00010000:1.0:1767317533.401551:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d325 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317533.401555:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401562:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.401574:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401579:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401593:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401601:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401608:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.401617:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401622:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401629:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401636:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401643:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.401808:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.401819:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.401827:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.401836:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.401853:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.401857:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.401860:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d31e 00000080:00010000:1.0:1767317533.401865:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d31e from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317533.401868:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.402292:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.402303:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.402312:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=266 00000080:00200000:1.0:1767317533.402321:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148), inode mode 41ed mask 44 00000080:00200008:1.0:1767317533.402332:0:83367:0:(file.c:1001:ll_file_open()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), flags 704400 00000002:00010000:1.0:1767317533.402355:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317533.402423:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.402431:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317533.402446:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317533.402458:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291717632/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317533.402469:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.402494:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717632:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.403495:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.409360:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717632:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.409393:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409411:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409418:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409426:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409434:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409441:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.409447:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409453:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409460:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409468:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317533.409475:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.409481:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d33a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317533.409530:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1500 x1853164291717632/t8589937334(8589937334) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317533.409544:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291717632/t8589937334(8589937334) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.409565:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.409608:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 4096 00000002:00100000:1.0:1767317533.409631:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1500 x1853164291717632/t8589937334(8589937334) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317533.409828:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.409838:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148),name=d0h.sanity-flr 00000002:00010000:1.0:1767317533.409866:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.410307:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410323:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.410337:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.410345:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410353:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410364:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410389:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.410408:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.410416:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410424:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410432:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410439:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.410449:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.410456:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.410460:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d325 00000080:00010000:1.0:1767317533.410465:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d325 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317533.410468:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410474:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.410486:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.410490:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410502:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410510:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410517:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.410523:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.410528:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410534:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410541:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410548:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.410582:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317533.410595:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.410622:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.410628:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.410644:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.412604:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717760:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.412968:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.423774:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717760:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.424829:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.424853:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.425582:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.425611:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.425630:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317533.426682:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717888:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317533.427239:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.437343:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291717888:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317533.438143:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.438190:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317533.438296:0:83367:0:(file.c:424:ll_file_release()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), flags 704000 00000002:00100000:0.0:1767317533.438408:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1500 x1853164291717632/t8589937334(8589937334) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317533.438425:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317533.438434:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f800 x1853164291718144/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317533.438467:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718144:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317533.438619:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.445363:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718144:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317533.445420:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1500 x1853164291717632/t8589937334(8589937334) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317533.445532:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.445556:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.445579:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.445597:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.445606:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.445612:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.445615:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d31e 00000080:00010000:0.0:1767317533.445643:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d31e from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317533.445647:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.445656:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.445674:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.445681:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=266 00000080:00200000:0.0:1767317533.445689:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148), inode mode 41ed mask 44 00000080:00200008:0.0:1767317533.445797:0:83367:0:(file.c:1001:ll_file_open()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), flags 704400 00000002:00010000:0.0:1767317533.445821:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317533.446185:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.446194:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317533.446207:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317533.446224:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f800 x1853164291718400/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317533.446233:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.446260:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718400:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.446582:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.453631:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718400:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.453678:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.453729:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.453743:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.453757:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.453780:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9f800 x1853164291718400/t8589937336(8589937336) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317533.453794:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f800 x1853164291718400/t8589937336(8589937336) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.453814:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.453826:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935618/28 (0 0) 00000080:00200000:0.0:1767317533.453836:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.454401:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.454415:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d341 00000080:00010000:0.0:1767317533.454426:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d341 from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317533.454432:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454442:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.454491:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f800 x1853164291718400/t8589937336(8589937336) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317533.454586:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317533.454595:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148),name=d0h.sanity-flr 00000002:00010000:0.0:1767317533.454620:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.454646:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454661:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.454671:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.454678:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454686:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454694:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454701:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.454711:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.454719:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454742:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454750:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454757:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.454767:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317533.454775:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) 00000080:00010000:0.0:1767317533.454779:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d325 00000080:00010000:0.0:1767317533.454782:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d325 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317533.454785:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454792:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.454804:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.454809:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454817:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454824:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454840:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.454848:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.454853:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454860:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.454867:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.456204:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.456297:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317533.456329:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.456384:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.456397:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.456407:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317533.456424:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317533.456428:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.456444:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.456457:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.456466:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.456474:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317533.456490:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317533.456493:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.456500:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.456549:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:0.0:1767317533.456584:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.456605:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff8c3c61721148), flags=0 00000080:00200000:0.0:1767317533.456610:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff8c3c61721148), intent=getattr 00000002:00010000:0.0:1767317533.456634:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0h.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.457314:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.457329:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.457343:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.457391:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718528:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.457533:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.461804:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718528:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.461841:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462083:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462093:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462107:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462122:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462136:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462144:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.462152:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.462165:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291718528/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.462296:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.462311:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.462324:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/29 (0 0) 00000080:00200000:0.0:1767317533.462334:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x4:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.462386:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1d:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317533.462478:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1d:0x0], updating i_size 158 00000080:00200000:0.0:1767317533.462506:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1d:0x0]: layout version change: 4294967294 -> 21 00000080:00010000:0.0:1767317533.462512:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1d:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d348 00000080:00010000:0.0:1767317533.462527:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1d:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317533.462531:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d348 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317533.462535:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317533.463275:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317533.463324:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148), inode mode 41ed mask 3 00000080:00200000:1.0:1767317533.463457:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff8c3c61721148) 00010000:00010000:1.0:1767317533.463518:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.463626:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317533.463638:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1d:0x0]: losing layout lock 00010000:00010000:1.0:1767317533.463686:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317533.463694:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 1/0,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.463799:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317533.463803:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d348 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72481 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317533.463835:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d32c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72434 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317533.463860:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317533.464399:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3480 x1853164291718784/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317533.464434:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718784:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317533.464587:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.470015:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291718784:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317533.470097:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1d:0x0] ignore/verify layout 1/0, layout version 11 restore needed 0 00020000:00200000:1.0:1767317533.470116:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1d:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317533.470120:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317533.470130:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767317533.470142:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x16 00000080:00200000:1.0:1767317533.470191:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317533.470202:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1d:0x0](ffff8c3c617342c8) 00000080:00200008:1.0:1767317533.470365:0:83367:0:(file.c:424:ll_file_release()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff8c3c61721148), flags 704000 00010000:00010000:1.0:1767317533.470402:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.470456:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.470475:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.470486:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.470495:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.470521:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.470528:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.470532:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d31e 00000080:00010000:1.0:1767317533.470541:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d31e from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317533.470545:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.470554:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.470574:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.470588:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=0 00000080:00200000:1.0:1767317533.470597:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.470605:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.470612:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.470620:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.470627:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.470633:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.470636:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d31e 00000080:00010000:1.0:1767317533.470640:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d31e from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317533.470642:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.470649:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.470666:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317533.470674:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317533.470701:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.470733:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.470791:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9f800 x1853164291718400/t8589937336(8589937336) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.470805:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.470812:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291719040/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.470842:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719040:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.470994:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.476589:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719040:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.476641:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9f800 x1853164291718400/t8589937336(8589937336) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317533.476725:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476788:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476797:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476823:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476829:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317533.476833:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d341 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7245e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476847:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72426 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.476863:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d31e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7240a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317533.477428:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317533.477440:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291719296/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317533.477468:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719296:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317533.477576:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:2.0:1767317533.489639:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.489778:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379199616 00000100:00100000:3.0:1767317533.489794:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379199616 00000100:00100000:3.0:1767317533.489931:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9495 00000100:00100000:3.0:1767317533.489945:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379199616:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.489969:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.490075:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.490083:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379199616:12345-192.168.202.133@tcp:104: Request processed in 142us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.490091:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9495 00010000:00010000:1.0:1767317533.490524:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.490535:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490547:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.490553:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490563:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490596:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490719:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490727:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.490753:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490762:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d333 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72442 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.490782:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.490784:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.490785:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.490796:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317533.490815:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291719424:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.496674:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291719424:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.516671:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719296:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317533.516834:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff8c3c61721148) 00000080:00200000:0.0:1767317533.520136:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.520670:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.521508:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.521524:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.521560:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.521595:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719552:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.522897:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.527343:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719552:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.527380:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527395:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527409:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527424:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527437:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527443:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527448:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.527457:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291719552/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.527491:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527506:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317533.527512:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.527551:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.527557:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d34f 00000080:00010000:0.0:1767317533.527563:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.527566:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d34f from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317533.527568:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.527574:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.527602:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.527622:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317533.527626:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317533.527653:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.527817:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.527824:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.527832:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.527853:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719680:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.528256:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.532107:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719680:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.532142:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532315:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532324:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532338:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532352:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532368:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532376:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532383:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.532395:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291719680/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.532412:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.532449:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/103 (0 0) 00000080:00200000:0.0:1767317533.532458:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.532512:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08) 00000002:00010000:0.0:1767317533.532554:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.532611:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.532617:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.532623:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.532641:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719808:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.534491:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.536561:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719808:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.536588:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536621:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536632:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536640:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536652:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536657:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536663:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.536671:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291719808/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.536682:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536695:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/7 (0 0) 00010000:00010000:1.0:1767317533.536711:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.536716:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.536752:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.536802:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.536807:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.536814:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.536833:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719936:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.537144:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.537305:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.542657:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291719936:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.542693:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542720:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542735:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542749:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542764:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542772:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542808:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.542822:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3100 x1853164291719936/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.542839:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542856:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/7 (0 0) 00010000:00010000:1.0:1767317533.542865:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.542907:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.543476:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x67:0x0], updating i_size 8192 00000080:00010000:1.0:1767317533.543492:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d356 00000080:00010000:1.0:1767317533.543508:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) 00000080:00010000:1.0:1767317533.543513:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d356 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317533.543517:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543525:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317533.543565:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.543574:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08),name=d204a.sanity-flr 00000002:00010000:1.0:1767317533.543620:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.543634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543647:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.543658:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.543665:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543672:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543680:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543688:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.543793:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.543801:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543810:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543818:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.543826:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.543846:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.543852:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) 00000080:00010000:1.0:1767317533.543856:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d356 00000080:00010000:1.0:1767317533.543861:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d356 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317533.543865:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544563:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.544585:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.544595:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544605:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544614:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544622:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.544632:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.544637:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544646:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544664:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.544672:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.544859:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.545126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.545136:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.545374:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.545382:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.545390:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.545393:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d34f 00000080:00010000:1.0:1767317533.545399:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d34f from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317533.545403:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.545411:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.545421:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.545430:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204a.sanity-flr, flags=266 00000080:00200000:1.0:1767317533.545438:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317533.545448:0:83367:0:(file.c:1001:ll_file_open()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff8c3c61734b08), flags 704400 00000002:00010000:1.0:1767317533.545476:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317533.545549:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.545556:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317533.545571:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317533.545585:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291720192/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317533.545595:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.545621:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720192:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.546455:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.551781:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720192:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.551815:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.551832:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.551840:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.551849:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.551858:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.552091:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.552097:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.552106:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.552115:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.552123:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317533.552133:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.552141:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317533.552517:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c3100 x1853164291720192/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317533.552532:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3100 x1853164291720192/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.552553:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.552599:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x67:0x0], updating i_size 4096 00000002:00100000:1.0:1767317533.552622:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c3100 x1853164291720192/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317533.552816:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.552826:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08),name=d204a.sanity-flr 00000002:00010000:1.0:1767317533.552860:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.553399:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553418:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.553433:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.553440:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553449:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553460:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553470:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.553490:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.553501:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553509:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553516:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553522:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.553545:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.553553:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) 00000080:00010000:1.0:1767317533.553558:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d356 00000080:00010000:1.0:1767317533.553563:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d356 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317533.553567:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553574:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.553587:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.553594:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553602:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553610:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553616:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.553624:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.553629:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553636:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553651:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553658:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.553710:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317533.553728:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.553757:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.553764:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.553771:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.557319:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720320:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.557458:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.578305:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720320:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.579414:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.579436:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.579468:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x7:0x0]) in obj [0x240000405:0x7:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.579509:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.579526:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.583429:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720448:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.583574:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.614445:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720448:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.615354:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.615374:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.615457:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317533.615482:0:83367:0:(file.c:424:ll_file_release()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff8c3c61734b08), flags 704000 00000002:00100000:1.0:1767317533.615573:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c3100 x1853164291720192/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.615587:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.615593:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291720704/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.615622:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720704:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.615743:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.627739:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720704:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.627786:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c3100 x1853164291720192/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.628122:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.628289:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.628311:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629331:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.629354:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.629367:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.629371:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d34f 00000080:00010000:0.0:1767317533.629383:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d34f from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317533.629387:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629397:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.629419:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.629455:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204a.sanity-flr, flags=0 00000080:00200000:0.0:1767317533.629463:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.629482:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.629494:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629503:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.629509:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.629513:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.629515:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d34f 00000080:00010000:0.0:1767317533.629519:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d34f from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317533.629522:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629528:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.629536:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317533.629543:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317533.629567:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629596:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629643:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629662:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629668:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317533.629671:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d356 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a724f1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.629691:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d34f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a724d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317533.635433:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317533.635452:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ed80 x1853164291720960/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317533.635492:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720960:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317533.635632:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.639448:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.639532:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317533.639559:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379200640 00000100:00100000:3.0:1767317533.639571:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379200640 00000100:00100000:3.0:1767317533.639636:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9496 00000100:00100000:3.0:1767317533.639649:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379200640:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.639672:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.639780:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.639788:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379200640:12345-192.168.202.133@tcp:104: Request processed in 142us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.639797:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9496 00010000:00010000:0.0:1767317533.641108:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317533.641123:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641138:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.641154:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641167:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641187:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641377:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641386:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.641427:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641435:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d35d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a724ff expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.641459:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.641461:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.641463:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317533.641477:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317533.641503:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291721088:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.646725:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291721088:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317533.650788:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317533.654944:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379200896 00000100:00100000:2.0:1767317533.654971:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379200896 00000100:00100000:2.0:1767317533.655067:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9497 00000100:00100000:2.0:1767317533.655080:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379200896:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317533.655105:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.655246:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317533.655254:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379200896:12345-192.168.202.133@tcp:104: Request processed in 177us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317533.655266:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9497 00010000:00010000:1.0:1767317533.655392:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.655401:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655411:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.655418:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655428:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655438:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655590:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655598:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.655638:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655646:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d364 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7250d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.655690:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.655692:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.655694:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.655715:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317533.655734:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291721216:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.662033:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291721216:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.683864:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291720960:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.683983:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x67:0x0](ffff8c3c61734b08) 00000080:00200000:0.0:1767317533.684085:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.684113:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.684195:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.684215:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.684226:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.684268:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721344:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.684385:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.687326:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721344:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.687361:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687377:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687392:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687406:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687420:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687428:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687435:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.687447:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291721344/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.687466:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687502:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317533.687508:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.687540:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.687546:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d372 00000080:00010000:0.0:1767317533.687552:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.687555:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d372 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317533.687558:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.687564:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.687591:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.687614:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317533.687618:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317533.687641:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.687682:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.687687:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.687706:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.687724:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721472:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.687804:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.692797:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721472:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.692860:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693371:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x68:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693383:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693397:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693411:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693426:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693436:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693444:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.693473:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291721472/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.693489:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.693501:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/104 (0 0) 00000080:00200000:1.0:1767317533.693508:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.693567:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148) 00000002:00010000:1.0:1767317533.693603:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.693669:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.693677:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.693687:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.693727:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721600:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.693849:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.697513:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721600:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.697545:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697559:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697573:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697606:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697623:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697632:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697640:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.697653:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0a80 x1853164291721600/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.697670:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697687:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/8 (0 0) 00010000:00010000:1.0:1767317533.697710:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.697718:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.697754:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.697816:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.697846:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.697857:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.698482:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721728:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.698601:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.704121:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721728:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.704165:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704185:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704198:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704218:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704232:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704240:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704247:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.704283:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0a80 x1853164291721728/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.704299:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704314:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/8 (0 0) 00010000:00010000:1.0:1767317533.704322:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704330:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.704375:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x68:0x0], updating i_size 8192 00000080:00010000:1.0:1767317533.704389:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d379 00000080:00010000:1.0:1767317533.704405:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.704409:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d379 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317533.704413:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704420:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317533.704459:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204b.sanity-flr:[0x200000405:0x68:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.704468:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148),name=d204b.sanity-flr 00000002:00010000:1.0:1767317533.704498:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x68:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704509:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704527:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.704538:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704546:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704553:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704561:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704567:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.704576:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704580:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704587:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704595:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704603:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.704632:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.704638:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.704641:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d379 00000080:00010000:1.0:1767317533.704646:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d379 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317533.704649:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704655:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.704666:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704672:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704680:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704687:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704706:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.704716:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704720:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704727:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704744:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704751:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.704824:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.704834:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.704842:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704850:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.704856:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.704861:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.704863:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d372 00000080:00010000:1.0:1767317533.704867:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d372 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317533.704929:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.704938:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.704946:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.704955:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204b.sanity-flr, flags=266 00000080:00200000:1.0:1767317533.704962:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148), inode mode 41ed mask 44 00000080:00200008:1.0:1767317533.704971:0:83367:0:(file.c:1001:ll_file_open()) START file d204b.sanity-flr:[0x200000405:0x68:0x0](ffff8c3c61721148), flags 704400 00000002:00010000:1.0:1767317533.704996:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x68:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317533.705061:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.705069:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317533.705082:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317533.705091:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291721984/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317533.705101:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.705127:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721984:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.705382:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.710120:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291721984:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.710665:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710682:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710688:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710695:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710709:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710737:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.710741:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710746:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710751:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710756:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317533.710763:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.710768:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d38e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317533.710788:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c0a80 x1853164291721984/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317533.710799:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0a80 x1853164291721984/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.710815:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.710857:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x68:0x0], updating i_size 4096 00000002:00100000:1.0:1767317533.711356:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0a80 x1853164291721984/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317533.711452:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204b.sanity-flr:[0x200000405:0x68:0x0](ffff8c3c61721148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317533.711460:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148),name=d204b.sanity-flr 00000002:00010000:1.0:1767317533.711484:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x68:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.711506:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711517:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.711524:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.711529:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711533:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711538:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711543:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.711556:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.711562:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711568:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711572:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711575:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.711587:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317533.711592:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) 00000080:00010000:1.0:1767317533.711595:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x68:0x0](ffff8c3c61721148) for lock 0x73c3d5cb1442d379 00000080:00010000:1.0:1767317533.711599:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d379 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317533.711601:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711606:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.711613:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.711616:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711620:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711624:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711629:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.711632:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.711634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711638:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711647:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711652:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.711679:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317533.711692:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.711716:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.711722:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.711730:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.712829:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722112:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.713040:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.729134:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722112:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.731404:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.731429:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.731460:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317533.731499:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.731515:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317533.732521:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722240:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317533.732714:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.742201:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722240:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.743277:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.743298:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.743381:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317533.743406:0:83367:0:(file.c:424:ll_file_release()) START file d204b.sanity-flr:[0x200000405:0x68:0x0](ffff8c3c61721148), flags 704000 00000002:00100000:1.0:1767317533.743506:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0a80 x1853164291721984/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.743521:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.743527:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291722496/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.743556:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722496:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.743672:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.748989:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722496:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.749039:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0a80 x1853164291721984/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.749147:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.749173:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.749196:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749242:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.749254:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.749261:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.749266:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d372 00000080:00010000:1.0:1767317533.749274:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d372 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317533.749279:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749289:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.749309:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.749323:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204b.sanity-flr, flags=0 00000080:00200000:1.0:1767317533.749332:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.749339:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.749346:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749355:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.749378:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.749382:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.749385:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d372 00000080:00010000:1.0:1767317533.749390:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d372 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317533.749393:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749400:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.749409:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317533.749417:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317533.749445:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749485:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749534:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749542:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749548:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317533.749552:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d379 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x68:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7256f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.749570:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72553 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317533.749604:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317533.749612:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291722752/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317533.749642:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722752:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317533.750232:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.753087:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.753832:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379201920 00000100:00100000:3.0:1767317533.753849:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379201920 00000100:00100000:3.0:1767317533.753947:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9498 00000100:00100000:3.0:1767317533.753961:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379201920:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.753984:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.754085:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.754093:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379201920:12345-192.168.202.133@tcp:104: Request processed in 135us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.754101:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9498 00010000:00010000:1.0:1767317533.754332:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.754341:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754350:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.754356:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754365:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754375:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754530:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754537:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.754579:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754587:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d380 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7257d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.754624:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.754625:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.754627:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.754638:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317533.754659:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291722880:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317533.759421:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.759461:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379202176 00000100:00100000:3.0:1767317533.759486:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379202176 00000100:00100000:3.0:1767317533.759554:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9499 00000100:00100000:3.0:1767317533.759567:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379202176:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.759593:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.759709:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.759717:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379202176:12345-192.168.202.133@tcp:104: Request processed in 152us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.759725:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9499 00010000:00010000:1.0:1767317533.760367:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.760378:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760389:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.760395:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760404:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760412:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760555:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760563:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.760589:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760597:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d387 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7258b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.760640:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.760642:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.760643:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.760668:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317533.760699:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291723008:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.765536:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291722880:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.773104:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291723008:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.782621:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291722752:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.782685:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x68:0x0](ffff8c3c61721148) 00000080:00200000:0.0:1767317533.782819:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.782850:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.783220:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.783233:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.783245:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.783273:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723136:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.783387:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.786442:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723136:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.786475:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786490:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786503:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786533:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786547:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786556:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786564:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.786576:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ce00 x1853164291723136/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.786594:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786610:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317533.786619:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.786656:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317533.786664:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d395 00000080:00010000:0.0:1767317533.786671:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.786674:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d395 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317533.786677:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.786686:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.786740:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.786772:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317533.786777:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317533.786810:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.787318:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.787332:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.787346:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.787375:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723264:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.787493:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.791403:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723264:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.791442:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791470:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791479:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791493:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791532:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791547:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791556:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791563:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.791576:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ce00 x1853164291723264/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.791593:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.791605:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/107 (0 0) 00000080:00200000:0.0:1767317533.791614:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317533.791679:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08) 00000002:00010000:0.0:1767317533.791816:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.792068:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.792077:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.792086:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.792117:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723392:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.792351:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.794961:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723392:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.794989:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795003:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795018:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795028:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795043:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795051:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795059:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.795070:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291723392/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.795086:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795118:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/9 (0 0) 00010000:00010000:0.0:1767317533.795127:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.795136:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.795177:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.795245:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.795253:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.795263:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.795283:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723520:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.795777:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.798543:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723520:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.798572:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 4/1,0 mode: --/CR res: [0x240000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798587:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 4/1,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798602:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798636:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798653:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798660:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798667:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317533.798678:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ca80 x1853164291723520/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317533.798694:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798808:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/9 (0 0) 00010000:00010000:0.0:1767317533.798818:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.798826:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.799058:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6b:0x0], updating i_size 8192 00000080:00010000:0.0:1767317533.799074:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d39c 00000080:00010000:0.0:1767317533.799091:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317533.799096:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d39c from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317533.799111:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799120:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317533.799160:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317533.799286:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08),name=d204c.sanity-flr 00000002:00010000:0.0:1767317533.799321:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799335:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799347:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.799356:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799363:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799370:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799376:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799382:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.799390:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799395:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799409:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799416:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799423:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.799433:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317533.799438:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317533.799442:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d39c 00000080:00010000:0.0:1767317533.799446:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d39c from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317533.799449:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799456:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.799469:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799475:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799482:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799490:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799508:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.799519:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799524:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799532:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799540:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799547:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.799622:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.799632:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.799640:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799647:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.799653:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.799657:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.799659:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d395 00000080:00010000:0.0:1767317533.799663:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d395 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317533.799673:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.799680:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.799688:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.799809:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204c.sanity-flr, flags=266 00000080:00200000:0.0:1767317533.799818:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08), inode mode 41ed mask 44 00000080:00200008:0.0:1767317533.799829:0:83367:0:(file.c:1001:ll_file_open()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff8c3c61734b08), flags 704400 00000002:00010000:0.0:1767317533.799848:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317533.800077:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.800085:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317533.800098:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317533.800110:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ce00 x1853164291723776/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317533.800121:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317533.800148:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723776:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317533.800725:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317533.809030:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723776:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317533.809061:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809076:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809106:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809113:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809121:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809128:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.809133:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809141:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809149:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809156:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317533.809164:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317533.809250:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d3b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317533.809277:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c50e9ce00 x1853164291723776/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317533.809290:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ce00 x1853164291723776/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317533.809310:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317533.809359:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6b:0x0], updating i_size 4096 00000002:00100000:0.0:1767317533.809384:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9ce00 x1853164291723776/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317533.809474:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317533.809483:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08),name=d204c.sanity-flr 00000002:00010000:0.0:1767317533.809511:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.809529:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809543:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.809554:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.809561:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809569:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809577:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809585:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.809604:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.809612:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809633:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809641:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809647:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.809658:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317533.809665:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317533.809669:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d39c 00000080:00010000:0.0:1767317533.809673:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d39c from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317533.809677:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809683:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.809805:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.809814:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809822:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809829:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.809850:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.809861:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.809866:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.810092:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.810101:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.810108:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.810145:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317533.810161:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.810191:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.810197:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.810216:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317533.811323:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723904:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317533.811516:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.821290:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291723904:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317533.822108:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.822128:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317533.822164:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x9:0x0]) in obj [0x240000405:0x9:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317533.822184:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.822201:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317533.822845:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724032:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317533.823028:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.831182:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724032:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317533.831848:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.832044:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.832137:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767317533.832162:0:83367:0:(file.c:424:ll_file_release()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff8c3c61734b08), flags 704000 00000002:00100000:0.0:1767317533.832272:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9ce00 x1853164291723776/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317533.832300:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317533.832307:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291724288/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317533.832340:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724288:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317533.832514:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317533.837111:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724288:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317533.837163:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9ce00 x1853164291723776/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317533.837271:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.837298:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.837323:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837340:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.837351:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.837357:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.837362:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d395 00000080:00010000:0.0:1767317533.837371:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d395 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317533.837375:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837385:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.837431:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317533.837445:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204c.sanity-flr, flags=0 00000080:00200000:0.0:1767317533.837453:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317533.837462:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317533.837469:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837478:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.837485:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317533.837489:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317533.837491:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d395 00000080:00010000:0.0:1767317533.837495:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d395 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317533.837498:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837506:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317533.837514:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317533.837522:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317533.837548:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837581:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837636:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837644:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837650:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317533.837653:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d39c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a725ed expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.837671:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d395 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a725d1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317533.837690:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317533.837712:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ca80 x1853164291724544/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317533.837741:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724544:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317533.837844:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.841114:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317533.841411:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379204992 00000100:00100000:2.0:1767317533.841426:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379204992 00000100:00100000:2.0:1767317533.841503:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9500 00000100:00100000:2.0:1767317533.841517:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379204992:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317533.841541:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.841653:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317533.841681:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379204992:12345-192.168.202.133@tcp:104: Request processed in 167us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317533.841690:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9500 00010000:00010000:1.0:1767317533.842536:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.842551:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842563:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.842570:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842579:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842588:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842749:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842758:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.842790:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842817:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d3a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a725fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.842839:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.842841:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.842843:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.842855:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317533.843282:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291724672:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317533.848736:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.848919:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379205248 00000100:00100000:3.0:1767317533.848933:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379205248 00000100:00100000:3.0:1767317533.849003:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9501 00000100:00100000:3.0:1767317533.849016:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379205248:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.849037:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.849130:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.849138:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379205248:12345-192.168.202.133@tcp:104: Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.849146:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9501 00000100:00100000:1.0:1767317533.849453:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291724672:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317533.850086:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317533.850097:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850109:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.850115:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850124:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850153:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850326:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850334:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.850370:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 1/0,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850378:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d3aa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72609 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.850401:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.850404:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.850406:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317533.850416:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317533.850435:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291724800:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.857504:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291724800:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.874725:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724544:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317533.874785:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff8c3c61734b08) 00000080:00200000:1.0:1767317533.876239:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.876286:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.876381:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.876394:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.876406:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.876436:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724928:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.876557:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.881729:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291724928:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.881769:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881786:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881823:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881837:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881854:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881862:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881936:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.881951:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291724928/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.881967:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.881983:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317533.881992:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.882030:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317533.882038:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3b8 00000080:00010000:1.0:1767317533.882046:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.882050:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3b8 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317533.882052:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.882070:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.882106:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.882136:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317533.882142:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317533.882191:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.882259:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.882268:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.882280:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.882308:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725056:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.882424:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.889121:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725056:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.889156:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889290:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889301:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889347:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889363:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889380:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889389:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889397:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.889410:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291725056/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.889428:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.889442:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/110 (0 0) 00000080:00200000:1.0:1767317533.889450:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.889522:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08) 00000002:00010000:1.0:1767317533.889560:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.889637:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.889645:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.889664:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.890102:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725184:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.890237:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.894375:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725184:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.894411:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894428:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894463:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894477:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894492:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894501:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894509:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.894522:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291725184/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.894540:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894556:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/10 (0 0) 00010000:00010000:3.0:1767317533.894565:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.894573:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.894612:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.894701:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: --/CR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.894709:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: --/CR res: [0x240000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.894719:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: --/CR res: [0x240000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317533.894747:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725312:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317533.894855:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.898791:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725312:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.898827:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 4/1,0 mode: --/CR res: [0x240000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898842:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 4/1,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898858:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898926:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898943:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898953:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.898962:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317533.898996:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1c00 x1853164291725312/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317533.899016:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899036:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/10 (0 0) 00010000:00010000:3.0:1767317533.899045:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899054:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.899100:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6e:0x0], updating i_size 8192 00000080:00010000:3.0:1767317533.899116:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3bf 00000080:00010000:3.0:1767317533.899135:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) 00000080:00010000:3.0:1767317533.899139:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3bf from it ffffa7f7c1c1fb20 00010000:00010000:3.0:1767317533.899144:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899154:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767317533.899194:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317533.899203:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08),name=d204d.sanity-flr 00000002:00010000:3.0:1767317533.899246:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899257:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899276:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.899287:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899295:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899303:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899310:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899317:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.899326:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899331:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899340:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899347:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899355:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.899377:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767317533.899382:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) 00000080:00010000:3.0:1767317533.899386:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3bf 00000080:00010000:3.0:1767317533.899390:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3bf from it ffffa7f7c1c1fcb8 00010000:00010000:3.0:1767317533.899394:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899400:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.899412:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899418:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899426:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899434:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899440:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.899448:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899453:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899460:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899473:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899479:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.899573:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317533.899583:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.899591:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899598:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.899604:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317533.899608:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317533.899610:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3b8 00000080:00010000:3.0:1767317533.899614:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3b8 from it ffffa7f7c1c1fbf8 00010000:00010000:3.0:1767317533.899617:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.899623:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.899632:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317533.899640:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204d.sanity-flr, flags=266 00000080:00200000:3.0:1767317533.899647:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08), inode mode 41ed mask 44 00000080:00200008:3.0:1767317533.899658:0:83367:0:(file.c:1001:ll_file_open()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff8c3c61722a08), flags 704400 00000002:00010000:3.0:1767317533.899682:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1767317533.899748:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.899756:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:3.0:1767317533.899770:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317533.899779:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1c00 x1853164291725568/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317533.899790:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317533.899817:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725568:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317533.900102:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317533.903931:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725568:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317533.903963:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.903980:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.903988:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.903996:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904006:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904040:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c91800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:3.0:1767317533.904046:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904053:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904062:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904070:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767317533.904078:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317533.904086:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d3d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:3.0:1767317533.904109:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c58fc1c00 x1853164291725568/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317533.904124:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1c00 x1853164291725568/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317533.904143:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317533.904195:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6e:0x0], updating i_size 4096 00000002:00100000:3.0:1767317533.904226:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1c00 x1853164291725568/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767317533.904319:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317533.904328:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08),name=d204d.sanity-flr 00000002:00010000:3.0:1767317533.904354:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.904381:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904394:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.904406:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.904413:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904420:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904430:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904438:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.904455:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.904463:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904472:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904479:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904485:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.904502:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767317533.904508:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) 00000080:00010000:3.0:1767317533.904512:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3bf 00000080:00010000:3.0:1767317533.904517:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3bf from it ffffa7f7c1c1fcd8 00010000:00010000:3.0:1767317533.904521:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904527:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.904538:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.904544:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904551:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904558:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904564:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.904572:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317533.904576:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904583:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904597:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904604:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317533.904637:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08) pos/size0/8192 32bit_api 0 00010000:00010000:3.0:1767317533.904650:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317533.904675:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767317533.904681:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.904689:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767317533.906558:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725696:192.168.202.133@tcp:37:rm.0 00000100:00100000:3.0:1767317533.906781:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1767317533.920649:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725696:192.168.202.133@tcp:37:rm.0 00010000:00010000:3.0:1767317533.921836:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.921860:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317533.922456:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xa:0x0]) in obj [0x240000405:0xa:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317533.922479:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317533.922498:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767317533.923630:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725824:192.168.202.133@tcp:37:rm.0 00000100:00100000:2.0:1767317533.924059:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.933666:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291725824:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317533.934579:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.934599:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.934679:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317533.934704:0:83367:0:(file.c:424:ll_file_release()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff8c3c61722a08), flags 704000 00000002:00100000:1.0:1767317533.934805:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc1c00 x1853164291725568/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317533.934819:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317533.934826:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0e00 x1853164291726080/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317533.934857:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726080:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317533.935425:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317533.941656:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726080:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317533.941798:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc1c00 x1853164291725568/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317533.942233:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.942281:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.942308:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942326:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.942336:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.942344:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.942348:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3b8 00000080:00010000:1.0:1767317533.942359:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3b8 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317533.942363:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942373:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.942394:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.942407:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204d.sanity-flr, flags=0 00000080:00200000:1.0:1767317533.942415:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.942422:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.942428:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942436:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.942442:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317533.942446:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.942448:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3b8 00000080:00010000:1.0:1767317533.942461:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3b8 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317533.942464:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942471:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.942480:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317533.942486:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317533.942510:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942541:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942586:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942593:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942599:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317533.942601:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3bf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7266b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.942618:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7264f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317533.942636:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317533.942645:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0e00 x1853164291726336/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317533.942678:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726336:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317533.942810:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317533.947814:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.948337:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379206272 00000100:00100000:3.0:1767317533.948374:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379206272 00000100:00100000:3.0:1767317533.948455:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9502 00000100:00100000:3.0:1767317533.948467:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379206272:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.948490:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.949299:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.949313:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379206272:12345-192.168.202.133@tcp:104: Request processed in 845us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.949323:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9502 00010000:00010000:0.0:1767317533.951339:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317533.951360:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951377:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317533.951384:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951421:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951433:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951574:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951582:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317533.951637:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951646:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d3c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72679 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317533.951671:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.951673:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317533.951675:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317533.951706:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317533.951733:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291726464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317533.955630:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291726464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317533.958394:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317533.958553:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317533.958580:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379206528 00000100:00100000:3.0:1767317533.958592:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379206528 00000100:00100000:3.0:1767317533.958662:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9503 00000100:00100000:3.0:1767317533.958675:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379206528:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317533.958696:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317533.958796:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317533.958804:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379206528:12345-192.168.202.133@tcp:104: Request processed in 132us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317533.958812:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9503 00010000:00010000:1.0:1767317533.959810:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317533.959823:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.959838:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317533.959844:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.959854:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.959863:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.960071:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 2/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.960079:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317533.960109:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 1/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.960117:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d3cd lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72687 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.960139:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.960141:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317533.960162:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317533.960184:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317533.960219:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291726592:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.966524:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291726592:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317533.981424:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726336:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317533.981490:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff8c3c61722a08) 00000080:00200000:1.0:1767317533.981811:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317533.981846:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.982135:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.982149:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.982162:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.982219:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726720:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.982403:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.987481:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726720:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.987520:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987537:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987553:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987587:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987603:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987612:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987634:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.987648:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291726720/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.987666:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.987683:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317533.987692:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317533.987841:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317533.987849:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3db 00000080:00010000:1.0:1767317533.987857:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317533.987860:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3db from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317533.987864:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.988038:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317533.988077:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317533.988102:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317533.988108:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317533.988138:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204e.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.988266:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.988274:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.988287:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.988313:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726848:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.988477:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.992480:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726848:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.992513:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992543:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992553:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992567:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992605:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992619:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992629:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992637:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.992649:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291726848/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.992666:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.992677:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/111 (0 0) 00000080:00200000:1.0:1767317533.992685:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317533.992839:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08) 00000002:00010000:1.0:1767317533.993043:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.993117:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.993125:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.993135:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.993261:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726976:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.993416:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317533.996843:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291726976:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317533.997028:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997045:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997061:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997074:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997090:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997099:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997119:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317533.997132:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291726976/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317533.997149:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997336:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/11 (0 0) 00010000:00010000:1.0:1767317533.997347:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317533.997356:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317533.997393:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317533.997477:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.997485:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317533.997494:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317533.997520:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727104:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317533.997673:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.001454:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727104:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.001489:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 4/1,0 mode: --/CR res: [0x240000405:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001503:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001518:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001556:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001570:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001578:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001585:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.001597:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291727104/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317550 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.001613:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001629:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/11 (0 0) 00010000:00010000:1.0:1767317534.001637:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001645:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.001689:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6f:0x0], updating i_size 8192 00000080:00010000:1.0:1767317534.001808:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3e2 00000080:00010000:1.0:1767317534.001826:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.001831:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3e2 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.001842:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.001851:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317534.002074:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.002083:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08),name=d204e.sanity-flr 00000002:00010000:1.0:1767317534.002114:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002126:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002138:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.002148:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002155:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002162:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002262:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002270:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.002281:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002287:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002302:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002311:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002318:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.002331:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317534.002336:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.002340:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3e2 00000080:00010000:1.0:1767317534.002343:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3e2 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317534.002347:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002354:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.002367:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002373:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002380:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002388:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002406:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.002415:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002420:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002428:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002436:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002443:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.002527:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.002536:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.002544:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002552:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.002557:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.002561:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.002563:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3db 00000080:00010000:1.0:1767317534.002566:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3db from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317534.002577:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.002584:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.002593:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.002601:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204e.sanity-flr, flags=266 00000080:00200000:1.0:1767317534.002608:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317534.002619:0:83367:0:(file.c:1001:ll_file_open()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff8c3c61722a08), flags 704400 00000002:00010000:1.0:1767317534.002639:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317534.002814:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.002824:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317534.002840:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317534.002852:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291727360/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317534.002862:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.003015:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727360:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.003419:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.007422:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727360:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.007459:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007477:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007511:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007519:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007528:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007535:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.007541:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007549:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007557:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007563:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317534.007572:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.007578:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d3f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317534.007602:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1c00 x1853164291727360/t8589937352(8589937352) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317534.007618:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291727360/t8589937352(8589937352) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.007638:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.007685:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6f:0x0], updating i_size 4096 00000002:00100000:1.0:1767317534.007804:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291727360/t8589937352(8589937352) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317534.008157:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.008166:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08),name=d204e.sanity-flr 00000002:00010000:1.0:1767317534.008214:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.008235:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008250:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.008262:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.008270:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008277:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008287:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008296:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.008315:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.008324:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008348:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008356:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008363:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.008375:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317534.008382:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.008387:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d3e2 00000080:00010000:1.0:1767317534.008393:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3e2 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317534.008396:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008403:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.008414:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.008420:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008428:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008435:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008452:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.008461:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.008466:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008474:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008482:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008489:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.008521:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317534.008533:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.008559:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.008565:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.008572:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.009394:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727488:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.009532:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.017745:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727488:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317534.018752:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.018775:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.018807:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xb:0x0]) in obj [0x240000405:0xb:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.018825:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.018841:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.019959:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727616:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.020095:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.028092:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727616:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317534.029112:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.029133:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.029229:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317534.029256:0:83367:0:(file.c:424:ll_file_release()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff8c3c61722a08), flags 704000 00000002:00100000:1.0:1767317534.029351:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291727360/t8589937352(8589937352) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317534.029380:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317534.029387:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291727872/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317534.029416:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727872:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317534.029610:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.034093:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291727872:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317534.034139:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291727360/t8589937352(8589937352) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.034238:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.034264:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.034286:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034303:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.034312:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.034319:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.034323:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3db 00000080:00010000:1.0:1767317534.034332:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3db from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317534.034336:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034346:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.034387:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.034401:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204e.sanity-flr, flags=0 00000080:00200000:1.0:1767317534.034409:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.034417:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.034424:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034432:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.034438:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.034442:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.034445:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3db 00000080:00010000:1.0:1767317534.034448:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3db from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317534.034452:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034460:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.034469:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317534.034475:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317534.034502:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034535:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034593:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034601:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034609:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317534.034612:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d3e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a726e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.034630:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a726cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317534.034650:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317534.034658:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291728128/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317534.034684:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728128:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317534.034786:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.037939:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317534.038444:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379207552 00000100:00100000:3.0:1767317534.038460:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379207552 00000100:00100000:3.0:1767317534.038568:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9504 00000100:00100000:3.0:1767317534.038581:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379207552:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317534.038603:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.038725:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317534.038733:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379207552:12345-192.168.202.133@tcp:104: Request processed in 154us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317534.038741:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9504 00010000:00010000:0.0:1767317534.038796:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.038805:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.038815:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.038827:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.038837:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.038846:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.039007:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.039015:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.039042:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.039050:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d3e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a726f7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.039070:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.039071:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.039073:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317534.039082:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317534.039098:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291728256:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317534.044402:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317534.044444:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379207808 00000100:00100000:3.0:1767317534.044459:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379207808 00000100:00100000:3.0:1767317534.044526:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9505 00000100:00100000:3.0:1767317534.044537:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379207808:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317534.044560:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.044723:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291728256:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1767317534.045587:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317534.045602:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379207808:12345-192.168.202.133@tcp:104: Request processed in 1065us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317534.045613:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9505 00010000:00010000:0.0:1767317534.045674:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.045683:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045725:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.045731:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045741:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045750:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045916:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045924:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.045951:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045958:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d3f0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72705 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.045978:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.045980:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.045981:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317534.045990:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317534.046006:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291728384:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317534.054500:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291728384:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.066452:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728128:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317534.066515:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff8c3c61722a08) 00000080:00200000:1.0:1767317534.066635:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.066664:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.066757:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.066769:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.066808:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.066850:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728512:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.067047:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.070619:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728512:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.070656:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070672:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070687:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070699:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070726:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070734:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070741:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.070755:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291728512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.070795:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070811:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317534.070820:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.070906:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317534.070915:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3fe 00000080:00010000:1.0:1767317534.070922:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.070925:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3fe from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317534.070929:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.070938:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.070969:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.070993:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317534.070999:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317534.071029:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204f.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.071085:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.071093:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.071104:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.071129:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728640:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.071249:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.077427:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728640:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.077460:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077490:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077498:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077510:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077523:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077537:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077545:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077552:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.077562:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291728640/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/672 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.077578:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.077610:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/114 (0 0) 00000080:00200000:1.0:1767317534.077618:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.077673:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08) 00000002:00010000:1.0:1767317534.077723:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.077791:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.077799:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.077808:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.077834:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728768:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.078008:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.081521:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728768:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.081571:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081587:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081602:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081642:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081657:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081667:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081675:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.081688:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291728768/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.081704:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081720:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/12 (0 0) 00010000:00010000:3.0:1767317534.081730:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.081738:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.081775:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.081836:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.081852:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.081863:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.082415:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728896:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.082540:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.086363:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291728896:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.086397:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 4/1,0 mode: --/CR res: [0x240000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086412:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086426:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086439:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086453:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086478:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086485:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.086497:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1f80 x1853164291728896/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.086514:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086530:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/12 (0 0) 00010000:00010000:1.0:1767317534.086539:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086547:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.086591:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x72:0x0], updating i_size 8192 00000080:00010000:1.0:1767317534.086606:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d405 00000080:00010000:1.0:1767317534.086621:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.086625:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d405 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.086630:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086637:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317534.086686:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.086710:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08),name=d204f.sanity-flr 00000002:00010000:1.0:1767317534.086742:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.086752:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086765:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.086774:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.086780:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086788:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086796:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086802:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.086811:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.086817:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086825:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086844:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.086851:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.086861:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317534.086866:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.087077:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d405 00000080:00010000:1.0:1767317534.087083:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d405 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317534.087086:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087095:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.087110:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.087116:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087124:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087130:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087137:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.087158:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.087163:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087170:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087178:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087184:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.087263:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.087273:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.087281:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087290:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.087296:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.087301:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.087303:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3fe 00000080:00010000:1.0:1767317534.087307:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3fe from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317534.087310:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.087328:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.087338:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.087346:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204f.sanity-flr, flags=266 00000080:00200000:1.0:1767317534.087352:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317534.087363:0:83367:0:(file.c:1001:ll_file_open()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff8c3c61722a08), flags 704400 00000002:00010000:1.0:1767317534.087382:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317534.087443:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.087450:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317534.087464:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317534.087473:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291729152/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317534.087482:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.087507:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729152:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.088019:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.092223:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729152:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.092258:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092275:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092301:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092310:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092318:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092325:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.092331:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092339:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092346:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092353:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317534.092361:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.092368:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d41a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317534.092392:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1c00 x1853164291729152/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317534.092407:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291729152/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.092428:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.092477:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x72:0x0], updating i_size 4096 00000002:00100000:1.0:1767317534.092500:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291729152/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317534.092594:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.092603:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08),name=d204f.sanity-flr 00000002:00010000:1.0:1767317534.092630:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.092649:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.092664:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.092676:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.092683:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.092691:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093299:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093308:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.093331:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.093341:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093367:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093376:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093383:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.093396:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317534.093403:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.093407:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d405 00000080:00010000:1.0:1767317534.093412:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d405 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317534.093416:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093423:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.093436:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.093442:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093450:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093457:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093476:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.093487:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.093493:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093501:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093509:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093516:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.093554:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317534.093569:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.093599:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.093606:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.093615:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.094378:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729280:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.094524:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.106910:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729280:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317534.107628:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.107647:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.107679:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xc:0x0]) in obj [0x240000405:0xc:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.107697:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.107711:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.108353:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729408:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.108487:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.116276:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729408:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317534.117263:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.117285:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.117365:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317534.117392:0:83367:0:(file.c:424:ll_file_release()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff8c3c61722a08), flags 704000 00000002:00100000:1.0:1767317534.117486:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291729152/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317534.117514:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317534.117521:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291729664/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317534.117551:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729664:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317534.117826:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.122293:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729664:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317534.122352:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291729152/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.122447:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.122470:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.122494:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122510:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.122519:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.122525:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.122530:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3fe 00000080:00010000:1.0:1767317534.122538:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3fe from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317534.122542:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122551:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.122596:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.122609:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204f.sanity-flr, flags=0 00000080:00200000:1.0:1767317534.122617:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.122625:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.122631:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122640:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.122646:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.122650:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.122653:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d3fe 00000080:00010000:1.0:1767317534.122657:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d3fe from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317534.122660:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122668:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.122676:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317534.122682:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317534.122721:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122753:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122812:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122820:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122827:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317534.122830:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d405 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72767 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.122847:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d3fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7274b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317534.122866:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317534.122940:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291729920/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317534.122968:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729920:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317534.123088:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.125918:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.126135:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379208832 00000100:00100000:2.0:1767317534.126157:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379208832 00000100:00100000:2.0:1767317534.126228:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9506 00000100:00100000:2.0:1767317534.126240:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379208832:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.126261:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.126360:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.126367:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379208832:12345-192.168.202.133@tcp:104: Request processed in 129us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317534.126393:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9506 00010000:00010000:1.0:1767317534.128104:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317534.128118:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128133:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.128275:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128287:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128369:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128531:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128539:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317534.128627:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291730048:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317534.128857:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128866:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d40c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72775 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.128934:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.128937:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.128939:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317534.134577:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317534.134684:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379209088 00000100:00100000:3.0:1767317534.134706:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379209088 00000100:00100000:3.0:1767317534.134779:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9507 00000100:00100000:3.0:1767317534.134790:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379209088:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317534.134812:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.134961:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317534.134969:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379209088:12345-192.168.202.133@tcp:104: Request processed in 180us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317534.134976:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9507 00010000:00010000:1.0:1767317534.135457:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317534.135467:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135479:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c91800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.135485:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135495:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135504:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135681:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 2/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135690:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317534.135715:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135723:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d413 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72783 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.135742:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.135744:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.135746:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.135767:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291730176:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317534.139639:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291730048:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.144223:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291730176:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.156795:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291729920:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317534.156856:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x72:0x0](ffff8c3c61722a08) 00000080:00200000:1.0:1767317534.157021:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.157051:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.157130:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.157141:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.157151:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.157257:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730304:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.157356:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.166066:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730304:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.166102:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166118:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166131:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166143:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166157:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166165:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166185:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.166196:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291730304/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.166222:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166260:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317534.166269:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.166304:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317534.166313:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d421 00000080:00010000:1.0:1767317534.166320:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.166324:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d421 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317534.166327:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.166338:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.166369:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.166398:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317534.166403:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317534.166433:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d43b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.166486:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.166494:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.166504:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.166529:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730432:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.166627:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.172094:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730432:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.172292:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172322:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172331:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172345:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172358:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172373:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172381:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172390:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.172403:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291730432/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.172419:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.172430:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677442/1 (0 0) 00000002:00010000:1.0:1767317534.172458:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.172522:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.172530:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.172539:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.172566:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730560:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.172667:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.177342:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730560:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.177374:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177388:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177401:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177412:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177425:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177434:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177463:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.177475:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2a00 x1853164291730560/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/672 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.177490:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.177504:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677442/1 (0 0) 00000080:00200000:1.0:1767317534.177528:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.177575:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08) 00000002:00010000:1.0:1767317534.177609:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.177664:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.177671:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.177680:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.177788:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730688:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.178019:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.181396:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730688:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.181432:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181444:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181476:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181489:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181504:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181512:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181520:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.181532:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291730688/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.181548:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181564:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677443/1 (0 0) 00010000:00010000:1.0:1767317534.181573:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.181581:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.181618:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.181689:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.181789:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.181800:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.181824:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730816:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.182077:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.185507:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291730816:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.185540:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185554:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185569:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185581:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185595:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185604:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185612:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.185642:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1500 x1853164291730816/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.185659:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185675:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935617/4 (0 0) 00010000:00010000:1.0:1767317534.185683:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185794:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.185840:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 8192 00000080:00010000:1.0:1767317534.185855:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) for remote lock 0x73c3d5cb1442d42f 00000080:00010000:1.0:1767317534.185861:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d428 00000080:00010000:1.0:1767317534.185976:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.185982:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d428 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.185987:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.185995:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317534.186002:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d42f from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.186006:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186025:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317534.186062:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.186072:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08),name=d43b.sanity-flr 00000002:00010000:1.0:1767317534.186103:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186114:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186125:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.186135:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186142:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186468:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186478:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186486:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.186496:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186503:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186527:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186535:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186542:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.186553:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317534.186560:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) 00000080:00010000:1.0:1767317534.186564:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d42f 00000080:00010000:1.0:1767317534.186567:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d42f from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317534.186571:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186578:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.186591:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186597:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186604:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186611:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186629:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.186638:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186644:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186652:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186659:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186665:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.186838:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.186850:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.186859:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.186974:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.186982:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.186987:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.186990:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d421 00000080:00010000:1.0:1767317534.186994:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d421 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317534.187004:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.187011:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.187019:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.187027:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d43b.sanity-flr, flags=266 00000080:00200000:1.0:1767317534.187034:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317534.187044:0:83367:0:(file.c:1001:ll_file_open()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff8c3c61722a08), flags 704400 00000002:00010000:1.0:1767317534.187063:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317534.187133:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.187297:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317534.187313:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317534.187327:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2a00 x1853164291731072/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317534.187337:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.187365:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731072:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.187688:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.192351:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731072:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.192388:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192408:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192438:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192447:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192456:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192463:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.192469:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192477:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192484:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192492:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317534.192500:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.192507:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317534.192541:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c2a00 x1853164291731072/t4294976300(4294976300) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317534.192556:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2a00 x1853164291731072/t4294976300(4294976300) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.192576:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.192624:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 4096 00000002:00100000:1.0:1767317534.192649:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2a00 x1853164291731072/t4294976300(4294976300) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317534.192832:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff8c3c61722a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.192842:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08),name=d43b.sanity-flr 00000002:00010000:0.0:1767317534.193230:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.193250:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193264:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.193278:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.193284:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193292:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193302:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193310:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.193327:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.193336:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193345:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193353:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193367:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.193381:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317534.193387:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) 00000080:00010000:0.0:1767317534.193392:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff8c3c61722a08) for lock 0x73c3d5cb1442d42f 00000080:00010000:0.0:1767317534.193397:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d42f from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.193401:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193408:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.193420:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.193425:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193433:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193440:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193447:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.193454:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.193458:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193470:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193477:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193484:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.193521:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317534.193534:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.193561:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.193567:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.193575:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.194434:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731200:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317534.194558:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.204153:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731200:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317534.204932:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.204953:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.205003:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.205022:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.205036:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.205667:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731328:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317534.205795:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.214584:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731328:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317534.215579:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.215603:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.215684:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767317534.215710:0:83367:0:(file.c:424:ll_file_release()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff8c3c61722a08), flags 704000 00000002:00100000:0.0:1767317534.215810:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2a00 x1853164291731072/t4294976300(4294976300) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317534.215825:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317534.215831:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ce00 x1853164291731584/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317534.215862:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731584:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317534.216497:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.220352:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731584:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317534.220406:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2a00 x1853164291731072/t4294976300(4294976300) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.220499:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.220526:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.220549:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220565:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.220572:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.220577:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.220581:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d421 00000080:00010000:0.0:1767317534.220587:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d421 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317534.220591:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220598:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.220612:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.220622:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d43b.sanity-flr, flags=0 00000080:00200000:0.0:1767317534.220627:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.220632:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.220635:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220641:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.220663:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.220665:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.220667:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d421 00000080:00010000:0.0:1767317534.220670:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d421 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317534.220672:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220677:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.220682:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317534.220687:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317534.220776:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220822:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.220827:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317534.220918:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291731712:192.168.202.133@tcp:103:rm.0 00010000:00010000:0.0:1767317534.221552:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d428 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a727e5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.221593:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.221636:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.221643:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.221655:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d42f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a727f3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317534.221680:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317534.221690:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9fb80 x1853164291731968/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317534.221712:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731968:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317534.221773:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.225029:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291731712:192.168.202.133@tcp:103:rm.0 00000100:00100000:3.0:1767317534.225184:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.225387:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379210368 00000100:00100000:2.0:1767317534.225397:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379210368 00000100:00100000:2.0:1767317534.225506:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9508 00000100:00100000:2.0:1767317534.225517:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379210368:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.225539:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.225624:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.225632:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379210368:12345-192.168.202.133@tcp:104: Request processed in 117us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317534.225641:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9508 00010000:00010000:1.0:1767317534.225658:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317534.225666:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.225675:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317534.225681:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.225691:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.225701:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.225774:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.225782:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317534.225855:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732096:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317534.226035:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.226072:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d421 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a727c9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.226098:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.226100:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.226102:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317534.229721:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732096:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317534.233583:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317534.233671:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379211136 00000100:00100000:3.0:1767317534.233684:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379211136 00000100:00100000:3.0:1767317534.233748:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9509 00000100:00100000:3.0:1767317534.233756:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379211136:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317534.233774:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.233855:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317534.233861:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379211136:12345-192.168.202.133@tcp:104: Request processed in 106us (291us total) trans 0 rc 0/0 00010000:00010000:1.0:1767317534.233904:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317534.233913:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.233923:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1600 already unused, calling callback (ffffffffc1bd6b40) 00000100:00100000:3.0:1767317534.233925:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9509 00010000:00010000:1.0:1767317534.233929:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.233938:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.233946:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.234066:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.234074:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317534.234109:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.234117:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d436 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72801 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.234161:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.234163:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317534.234165:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.234175:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317534.234193:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732224:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.236967:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732224:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317534.238190:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.238479:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317534.238502:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379211392 00000100:00100000:2.0:1767317534.238512:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379211392 00000100:00100000:2.0:1767317534.238568:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9510 00000100:00100000:2.0:1767317534.238576:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379211392:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.238595:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.238673:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.238680:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379211392:12345-192.168.202.133@tcp:104: Request processed in 104us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317534.238687:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9510 00010000:00010000:0.0:1767317534.238717:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.238726:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.238734:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.238740:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.238750:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.238759:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.238967:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.238975:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.239009:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.239017:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7280f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.239121:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732352:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317534.239266:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.239269:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.239271:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.247661:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291732352:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317534.251191:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291731968:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317534.251267:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8c3c61722a08) 00000080:00200000:0.0:1767317534.251374:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.251398:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.251470:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.251478:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.251485:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.251504:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732480:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.251588:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.253723:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732480:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.253758:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253773:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253814:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253825:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253837:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253843:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253849:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.253858:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d500 x1853164291732480/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.253916:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253932:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317534.253939:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.253971:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317534.253977:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d44b 00000080:00010000:0.0:1767317534.253983:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.253985:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d44b from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317534.253987:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.253998:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.254025:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.254050:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317534.254054:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317534.254079:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.254119:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.254124:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.254132:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.254164:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732608:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.254265:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.256649:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732608:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.256675:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256696:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256704:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256739:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256752:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256766:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256773:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256779:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.256788:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d500 x1853164291732608/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.256800:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256807:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/15 (0 0) 00000080:00200000:0.0:1767317534.256814:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317534.256851:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00200000:0.0:1767317534.256862:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00010000:0.0:1767317534.256908:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d452 00000080:00010000:0.0:1767317534.256926:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317534.256930:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d452 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317534.256938:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.256944:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317534.256985:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.256991:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08),name=d44a.sanity-flr 00000002:00010000:0.0:1767317534.257015:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.257023:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.257031:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.257035:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.257038:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317534.257040:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d452 00000080:00010000:0.0:1767317534.257043:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d452 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317534.257045:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.257049:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.257103:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.257107:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.257111:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.257124:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.257128:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.257130:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.257132:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d44b 00000080:00010000:0.0:1767317534.257135:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d44b from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317534.257137:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.257152:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.257158:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.257164:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr, flags=266 00000080:00200000:0.0:1767317534.257170:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08), inode mode 41ed mask 44 00000080:00200008:0.0:1767317534.257181:0:83367:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), flags 704400 00000002:00010000:0.0:1767317534.257200:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317534.257291:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.257297:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317534.257307:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317534.257312:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d500 x1853164291732864/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317534.257318:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.257342:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732864:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.257551:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.260776:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732864:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.260810:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260827:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260834:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260842:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260851:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260858:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccca00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.260863:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260914:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260923:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260931:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317534.260940:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.260972:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317534.260998:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c50e9d500 x1853164291732864/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317534.261013:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d500 x1853164291732864/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.261035:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.261069:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000002:00100000:0.0:1767317534.261090:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9d500 x1853164291732864/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.261194:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.261211:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08),name=d44a.sanity-flr 00000002:00010000:0.0:1767317534.261239:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.261266:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.261280:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.261288:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.261295:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317534.261299:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d452 00000080:00010000:0.0:1767317534.261306:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d452 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.261310:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.261334:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.261379:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317534.261393:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000403:0xf:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.261400:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.261408:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.262063:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732992:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317534.262163:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.273419:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291732992:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317534.274066:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.274081:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317534.274153:0:83367:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), flags 704000 00000002:00100000:0.0:1767317534.274433:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9d500 x1853164291732864/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317534.274448:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317534.274455:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291733248/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317534.274508:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733248:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317534.274610:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.278373:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733248:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317534.278421:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9d500 x1853164291732864/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.278523:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.278549:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.278572:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.278588:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.278597:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.278603:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.278608:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d44b 00000080:00010000:0.0:1767317534.278616:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d44b from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317534.278620:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.278630:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.278649:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.278657:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr, flags=266 00000080:00200000:0.0:1767317534.278665:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08), inode mode 41ed mask 44 00000080:00200008:0.0:1767317534.278705:0:83367:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), flags 704400 00000002:00010000:0.0:1767317534.278723:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317534.278786:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.278793:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317534.278806:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317534.278813:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291733504/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317534.278823:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.278848:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733504:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.279298:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.283544:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733504:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.283588:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.283600:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.283615:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.283628:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.283645:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9f480 x1853164291733504/t8589937362(8589937362) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317534.283678:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f480 x1853164291733504/t8589937362(8589937362) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.283798:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.283813:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935619/15 (0 0) 00000080:00200000:0.0:1767317534.283821:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.283862:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00010000:0.0:1767317534.283983:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d460 00000080:00010000:0.0:1767317534.283994:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d460 from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317534.283999:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.284010:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.284045:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f480 x1853164291733504/t8589937362(8589937362) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.284140:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.284149:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08),name=d44a.sanity-flr 00000002:00010000:0.0:1767317534.284242:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.284256:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.284269:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.284290:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.284297:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00010000:0.0:1767317534.284302:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d452 00000080:00010000:0.0:1767317534.284306:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d452 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.284310:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.284318:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.284362:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317534.284392:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317534.284421:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.284441:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff8c3c61734b08), flags=0 00000080:00200000:0.0:1767317534.284446:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff8c3c61734b08), intent=getattr 00000002:00010000:0.0:1767317534.284459:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44a.sanity-flr.mirror~2,[0x0:0x0:0x0]) in obj [0x200000403:0xf:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.284510:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.284518:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.284529:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.284557:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733632:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.284854:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.288749:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733632:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.288796:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288823:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288832:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288845:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288860:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288898:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288909:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.288917:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.288930:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d500 x1853164291733632/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 600/1032 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.288943:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.288971:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317534.288984:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/18 (0 0) 00000080:00200000:0.0:1767317534.288994:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0xf:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317534.289040:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x12:0x0](ffff8c3c617300c8) 00000080:00200000:0.0:1767317534.289183:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x12:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:0.0:1767317534.289191:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x12:0x0](ffff8c3c617300c8) for lock 0x73c3d5cb1442d467 00000080:00010000:0.0:1767317534.289212:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x12:0x0](ffff8c3c617300c8) 00000080:00010000:0.0:1767317534.289216:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d467 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317534.289220:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317534.289230:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317534.289270:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08), inode mode 41ed mask 3 00000080:00200000:0.0:1767317534.289280:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff8c3c61734b08) 00010000:00010000:0.0:1767317534.289322:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.289346:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.289439:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317534.289452:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x12:0x0]: losing layout lock 00010000:00010000:0.0:1767317534.289500:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317534.289508:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.289515:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317534.289518:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d467 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a728cc expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317534.289534:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d452 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7288d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317534.289553:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317534.289562:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d500 x1853164291733888/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 512/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317534.289590:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733888:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317534.289689:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.293850:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291733888:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317534.294085:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x12:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317534.294105:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1767317534.294117:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00020000:00200000:2.0:1767317534.294127:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:2.0:1767317534.294133:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00000080:00200000:2.0:1767317534.294297:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x12:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317534.294308:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x12:0x0](ffff8c3c617300c8) 00000080:00200008:2.0:1767317534.294443:0:83367:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff8c3c61734b08), flags 704000 00010000:00010000:2.0:1767317534.294479:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.294537:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.294558:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.294568:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.294579:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.294587:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.294594:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.294598:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d44b 00000080:00010000:2.0:1767317534.294606:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d44b from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317534.294610:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.294618:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.294661:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.294679:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:2.0:1767317534.294684:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317534.294809:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.295028:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.295037:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.295048:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.295077:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734016:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.295402:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.299027:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734016:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.299066:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299088:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299097:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299111:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299154:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299266:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299278:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299286:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.299299:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3a680 x1853164291734016/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.299314:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299325:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/15 (0 0) 00000080:00200000:2.0:1767317534.299334:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317534.299371:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00200000:2.0:1767317534.299375:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000403:0xf:0x0](ffff8c3c61734b08): rc = 0 00000080:00010000:2.0:1767317534.299383:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) for lock 0x73c3d5cb1442d46e 00000080:00010000:2.0:1767317534.299397:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00010000:2.0:1767317534.299401:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d46e from it ffffa7f7c1c1fe00 00010000:00010000:2.0:1767317534.299405:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299414:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.299465:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.299488:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.299498:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299511:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.299518:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.299522:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.299526:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d44b 00000080:00010000:2.0:1767317534.299530:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d44b from it ffffa7f7c1c1fd88 00010000:00010000:2.0:1767317534.299533:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299540:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.299549:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317534.299558:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317534.299584:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299612:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.299626:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.299795:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9f480 x1853164291733504/t8589937362(8589937362) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317534.299811:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317534.299818:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3a680 x1853164291734272/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317534.299847:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734272:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317534.300188:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767317534.304338:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734272:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317534.304387:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9f480 x1853164291733504/t8589937362(8589937362) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767317534.304499:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 1/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.304511:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.304519:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.304525:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1767317534.304529:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d46e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72904 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.304543:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d460 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a728a9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.304583:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d44b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72871 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317534.304604:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317534.304611:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3a680 x1853164291734528/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317534.304635:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734528:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317534.305003:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.310804:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734528:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317534.311080:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0xf:0x0](ffff8c3c61734b08) 00000080:00200000:2.0:1767317534.311196:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.311233:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.311312:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.311333:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.311344:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.311371:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734656:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.311493:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.314783:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734656:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.314821:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314859:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314922:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314935:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314949:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314958:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.314966:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.314979:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39180 x1853164291734656/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.314996:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.315012:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767317534.315020:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317534.315060:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317534.315069:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d475 00000080:00010000:2.0:1767317534.315077:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.315087:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d475 from it ffffa7f7c1c1fb58 00010000:00010000:2.0:1767317534.315091:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.315100:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.315133:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.315161:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:2.0:1767317534.315166:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317534.315198:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.315266:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.315275:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.315287:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.315463:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734784:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.315571:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.320517:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734784:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.320554:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320584:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320593:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320620:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320634:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320649:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320658:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320665:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.320678:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39180 x1853164291734784/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.320705:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.320718:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677442/4 (0 0) 00000002:00010000:2.0:1767317534.320740:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x4:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.320801:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.320809:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.320819:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.320850:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734912:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.321260:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.326586:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291734912:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.326625:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326641:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326654:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326667:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326681:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326788:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.326799:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.326813:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38380 x1853164291734912/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.326831:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327073:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677442/4 (0 0) 00000080:00200000:2.0:1767317534.327101:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317534.327158:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88) 00000080:00200000:2.0:1767317534.327250:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x4:0x0], updating i_size 4096 00000080:00010000:2.0:1767317534.327260:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) for remote lock 0x73c3d5cb1442d483 00000080:00010000:2.0:1767317534.327266:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d47c 00000080:00010000:2.0:1767317534.327282:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) 00000080:00010000:2.0:1767317534.327287:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d47c from it ffffa7f7c1c1fb20 00010000:00010000:2.0:1767317534.327292:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327301:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1767317534.327317:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d483 from it ffffa7f7c1c1fb20 00010000:00010000:2.0:1767317534.327321:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327327:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767317534.327359:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff8c3c4857ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317534.327367:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88),name=d44a.sanity-flr-1 00000002:00010000:2.0:1767317534.327398:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.327408:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327435:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.327442:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.327448:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) 00000080:00010000:2.0:1767317534.327452:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d483 00000080:00010000:2.0:1767317534.327456:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d483 from it ffffa7f7c1c1fcb8 00010000:00010000:2.0:1767317534.327459:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327466:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.327532:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.327543:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.327553:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327563:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.327569:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.327573:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.327576:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d475 00000080:00010000:2.0:1767317534.327580:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d475 from it ffffa7f7c1c1fbf8 00010000:00010000:2.0:1767317534.327583:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.327601:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.327610:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.327619:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr-1, flags=266 00000080:00200000:2.0:1767317534.327625:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88), inode mode 41ed mask 44 00000080:00200008:2.0:1767317534.327636:0:83367:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff8c3c4857ba88), flags 704400 00000002:00010000:2.0:1767317534.327656:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767317534.328472:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.328487:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:2.0:1767317534.328502:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317534.328514:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38380 x1853164291735168/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317534.328524:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.328552:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735168:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.331161:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.335109:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735168:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.335143:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335161:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335285:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335293:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335302:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335309:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:2.0:1767317534.335314:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335441:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335449:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335457:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767317534.335465:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.335473:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:2.0:1767317534.335506:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c46a38380 x1853164291735168/t4294976303(4294976303) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767317534.335521:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38380 x1853164291735168/t4294976303(4294976303) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317534.335544:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317534.335589:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x4:0x0], updating i_size 4096 00000002:00100000:2.0:1767317534.335614:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a38380 x1853164291735168/t4294976303(4294976303) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767317534.335842:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff8c3c4857ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317534.335853:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88),name=d44a.sanity-flr-1 00000002:00010000:2.0:1767317534.336120:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.336139:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.336155:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.336163:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.336183:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) 00000080:00010000:2.0:1767317534.336189:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d483 00000080:00010000:2.0:1767317534.336195:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d483 from it ffffa7f7c1c1fcd8 00010000:00010000:2.0:1767317534.336199:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.336224:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.336265:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1767317534.336282:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x240000402:0x4:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317534.336290:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.336297:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767317534.337036:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735296:192.168.202.133@tcp:37:rm.0 00000100:00100000:2.0:1767317534.337163:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767317534.344832:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735296:192.168.202.133@tcp:37:rm.0 00010000:00010000:2.0:1767317534.346185:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.346219:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.346285:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:2.0:1767317534.346310:0:83367:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff8c3c4857ba88), flags 704000 00000002:00100000:2.0:1767317534.346409:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a38380 x1853164291735168/t4294976303(4294976303) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317534.346421:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317534.346427:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39180 x1853164291735552/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317534.346455:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735552:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317534.346629:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767317534.349600:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735552:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317534.349648:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a38380 x1853164291735168/t4294976303(4294976303) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/664 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317534.349843:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.350033:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.350076:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350094:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.350102:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.350109:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.350113:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d475 00000080:00010000:2.0:1767317534.350120:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d475 from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317534.350125:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350133:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.350151:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.350166:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr-1, flags=0 00000080:00200000:2.0:1767317534.350174:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.350182:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.350188:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350196:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.350213:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.350217:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.350219:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d475 00000080:00010000:2.0:1767317534.350224:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d475 from it ffffa7f7c1c1fd88 00010000:00010000:2.0:1767317534.350235:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350243:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.350252:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317534.350259:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317534.350284:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350338:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 1/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350345:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317534.350383:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d47c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72943 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350413:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350519:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.350527:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317534.350529:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d483 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72951 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317534.350551:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317534.350561:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38380 x1853164291735936/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317534.350595:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735936:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317534.350686:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.350855:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291735680:192.168.202.133@tcp:103:rm.0 00000100:00100000:2.0:1767317534.353741:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291735680:192.168.202.133@tcp:103:rm.0 00000100:00100000:3.0:1767317534.354415:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.357236:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379212928 00000100:00100000:2.0:1767317534.357257:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379212928 00000100:00100000:2.0:1767317534.357985:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9511 00000100:00100000:2.0:1767317534.358001:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379212928:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.358024:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.358129:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.358136:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379212928:12345-192.168.202.133@tcp:104: Request processed in 139us (3725us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317534.358145:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9511 00010000:00010000:0.0:1767317534.358219:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.358228:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358239:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.358245:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358255:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358264:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358368:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358375:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.358409:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358417:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72927 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.358441:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.358443:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.358445:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.358825:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291736064:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.370648:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291736064:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317534.388002:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291735936:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317534.388066:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x4:0x0](ffff8c3c4857ba88) 00000080:00200000:2.0:1767317534.388173:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.388210:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.388292:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.388304:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.388315:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.388371:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736192:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.388466:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.393157:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736192:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.393196:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393223:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393236:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393249:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393263:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393271:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393280:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.393292:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39180 x1853164291736192/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.393308:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393360:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767317534.393369:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317534.393406:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317534.393413:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d491 00000080:00010000:2.0:1767317534.393420:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.393424:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d491 from it ffffa7f7c1c1fb58 00010000:00010000:2.0:1767317534.393427:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.393437:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.393468:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.393493:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:2.0:1767317534.393499:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317534.393528:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.393584:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.393592:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.393603:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.393627:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736320:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.393735:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.401813:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736320:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.401921:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.401950:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.401958:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.401972:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.401985:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.401999:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402007:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402014:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317534.402026:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a39180 x1853164291736320/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317534.402040:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402052:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/20 (0 0) 00000080:00200000:2.0:1767317534.402067:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317534.402112:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00200000:2.0:1767317534.402122:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00010000:2.0:1767317534.402131:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d498 00000080:00010000:2.0:1767317534.402145:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00010000:2.0:1767317534.402149:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d498 from it ffffa7f7c1c1fb20 00010000:00010000:2.0:1767317534.402153:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402163:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767317534.402229:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317534.402238:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88),name=d44b.sanity-flr 00000002:00010000:2.0:1767317534.402271:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.402281:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402294:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.402301:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.402306:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00010000:2.0:1767317534.402310:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d498 00000080:00010000:2.0:1767317534.402314:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d498 from it ffffa7f7c1c1fcb8 00010000:00010000:2.0:1767317534.402317:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402324:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.402398:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.402407:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.402414:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402422:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.402429:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.402434:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.402436:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d491 00000080:00010000:2.0:1767317534.402440:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d491 from it ffffa7f7c1c1fbf8 00010000:00010000:2.0:1767317534.402443:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.402450:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.402458:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.402467:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44b.sanity-flr, flags=266 00000080:00200000:2.0:1767317534.402473:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 44 00000080:00200008:2.0:1767317534.402483:0:83367:0:(file.c:1001:ll_file_open()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags 704400 00000002:00010000:2.0:1767317534.402501:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767317534.402560:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.402567:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:2.0:1767317534.402591:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317534.402599:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39180 x1853164291736576/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317534.402609:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.402635:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736576:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.402922:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317534.408755:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736576:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317534.408790:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408808:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408817:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408825:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408833:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408840:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:2.0:1767317534.408846:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.408854:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.409135:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.409143:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767317534.409152:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.409158:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:2.0:1767317534.409184:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c46a39180 x1853164291736576/t8589937367(8589937367) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767317534.409199:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39180 x1853164291736576/t8589937367(8589937367) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317534.409225:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317534.409255:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000002:00100000:0.0:1767317534.412500:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39180 x1853164291736576/t8589937367(8589937367) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.412619:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.412630:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88),name=d44b.sanity-flr 00000002:00010000:0.0:1767317534.412683:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.412721:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.412744:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.412754:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.412765:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00010000:0.0:1767317534.412769:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d498 00000080:00010000:0.0:1767317534.412793:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d498 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.412798:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.412808:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.412851:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317534.412897:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000403:0x14:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.412905:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.412914:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.413621:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736704:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317534.417516:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.432274:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736704:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317534.433250:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.433272:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317534.433524:0:83367:0:(file.c:424:ll_file_release()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags 704000 00000002:00100000:0.0:1767317534.433631:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a39180 x1853164291736576/t8589937367(8589937367) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317534.433647:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317534.433671:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291736960/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317534.434810:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736960:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317534.437720:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.464016:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291736960:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317534.464077:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a39180 x1853164291736576/t8589937367(8589937367) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.464236:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.464265:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.464290:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.464309:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.464321:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.464329:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.464334:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d491 00000080:00010000:0.0:1767317534.464343:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d491 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317534.464348:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.464358:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.464380:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.464389:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44b.sanity-flr, flags=266 00000080:00200000:0.0:1767317534.464399:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 44 00000080:00200008:0.0:1767317534.464432:0:83367:0:(file.c:1001:ll_file_open()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags 704400 00000002:00010000:0.0:1767317534.464454:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317534.464521:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.464530:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317534.464544:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317534.464551:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291737216/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317534.464561:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.464587:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737216:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.464852:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.472496:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737216:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.472544:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.472558:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.472574:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.472590:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.472609:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c50e9c380 x1853164291737216/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317534.472647:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c380 x1853164291737216/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.472661:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.472674:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935619/20 (0 0) 00000080:00200000:0.0:1767317534.472682:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.472709:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00010000:0.0:1767317534.472715:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d4a6 00000080:00010000:0.0:1767317534.472724:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4a6 from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317534.472728:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.472739:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.472772:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9c380 x1853164291737216/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.472937:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.472947:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88),name=d44b.sanity-flr 00000002:00010000:0.0:1767317534.472975:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.472988:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.473000:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.473018:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.473024:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00010000:0.0:1767317534.473029:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d498 00000080:00010000:0.0:1767317534.473033:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d498 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.473037:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.473044:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.473088:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317534.473121:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317534.473150:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.473169:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags=0 00000080:00200000:0.0:1767317534.473174:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88), intent=getattr 00000002:00010000:0.0:1767317534.473189:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000403:0x14:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.473258:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.473266:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.473277:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.473301:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737344:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.482125:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.505700:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737344:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.505739:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505775:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505783:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505798:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505843:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505859:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505896:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.505905:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.505918:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d880 x1853164291737344/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/720 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.505931:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.505945:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.505957:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/21 (0 0) 00000080:00200000:1.0:1767317534.505967:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x14:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.506023:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8c3c485e3a88) 00000080:00200000:1.0:1767317534.506134:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x15:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:1.0:1767317534.506142:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x15:0x0](ffff8c3c485e3a88) for lock 0x73c3d5cb1442d4ad 00000080:00010000:1.0:1767317534.506156:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x15:0x0](ffff8c3c485e3a88) 00000080:00010000:1.0:1767317534.506160:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4ad from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317534.506172:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.506182:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317534.506236:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 3 00000080:00200000:1.0:1767317534.506248:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88) 00010000:00010000:1.0:1767317534.506296:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.506588:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.506673:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317534.506689:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x15:0x0]: losing layout lock 00010000:00010000:1.0:1767317534.506734:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 1/0,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.506742:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.506748:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317534.506750:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d4ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a729f9 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.506769:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d498 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a729ba expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317534.506803:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317534.506812:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291737600/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317534.506842:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737600:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317534.507752:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.515169:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737600:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317534.515264:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317534.515284:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317534.515345:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317534.515356:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8c3c485e3a88) 00000080:00200000:1.0:1767317534.515472:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.515495:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags=0 00000080:00200000:1.0:1767317534.515500:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88), intent=getattr 00000002:00010000:1.0:1767317534.515536:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44b.sanity-flr.mirror~1,[0x0:0x0:0x0]) in obj [0x200000403:0x14:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.515619:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.515631:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.515644:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.515671:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737728:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.515784:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.525421:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737728:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.525479:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525510:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525519:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525536:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525550:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525563:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525572:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.525579:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.525591:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3800 x1853164291737728/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 600/720 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.525605:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.525630:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.525643:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/24 (0 0) 00000080:00200000:1.0:1767317534.525650:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x14:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.525691:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x18:0x0](ffff8c3c485e3a88) 00000080:00200000:1.0:1767317534.525785:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x18:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:1.0:1767317534.525792:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x18:0x0](ffff8c3c485e3a88) for lock 0x73c3d5cb1442d4b4 00000080:00010000:1.0:1767317534.525804:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x18:0x0](ffff8c3c485e3a88) 00000080:00010000:1.0:1767317534.525808:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4b4 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317534.525811:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.525820:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317534.525858:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88), inode mode 41ed mask 3 00000080:00200000:1.0:1767317534.525930:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff8c3c4857ba88) 00010000:00010000:1.0:1767317534.525974:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317534.525992:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x18:0x0]: losing layout lock 00010000:00010000:1.0:1767317534.526040:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317534.526047:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317534.526051:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72a31 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317534.526095:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317534.526102:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3800 x1853164291737984/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 512/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317534.526128:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737984:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317534.526258:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.545247:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291737984:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317534.545350:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317534.545369:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317534.545409:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317534.545419:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x18:0x0](ffff8c3c485e3a88) 00000080:00200008:1.0:1767317534.545546:0:83367:0:(file.c:424:ll_file_release()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff8c3c4857ba88), flags 704000 00010000:00010000:1.0:1767317534.545585:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.545651:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.545675:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.545687:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.545698:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.545706:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.545713:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.545717:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d491 00000080:00010000:1.0:1767317534.545725:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d491 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317534.545747:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.545757:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.545775:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.545793:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:1.0:1767317534.545799:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317534.545817:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.545958:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.545967:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.545978:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.546005:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738112:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.546122:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.549568:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738112:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.549604:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549625:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549634:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549680:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549693:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549708:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549717:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549725:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.549738:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0380 x1853164291738112/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.549752:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549764:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935619/20 (0 0) 00000080:00200000:1.0:1767317534.549773:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.549807:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00200000:1.0:1767317534.549812:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000403:0x14:0x0](ffff8c3c4857ba88): rc = 0 00000080:00010000:1.0:1767317534.549819:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) for lock 0x73c3d5cb1442d4bb 00000080:00010000:1.0:1767317534.549833:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00010000:1.0:1767317534.549838:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4bb from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317534.549849:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.549858:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.549953:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.549980:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.549991:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.550003:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.550010:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.550015:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.550019:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d491 00000080:00010000:1.0:1767317534.550023:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d491 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317534.550026:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.550033:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.550042:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317534.550052:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317534.550079:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.550109:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.550130:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.550185:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9c380 x1853164291737216/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317534.550198:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317534.550215:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291738368/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317534.550244:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738368:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317534.550361:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.555512:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738368:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317534.555573:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9c380 x1853164291737216/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317534.555690:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 1/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.555701:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.555709:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.555715:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317534.555719:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72a69 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.555759:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d4a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a729d6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.555776:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7299e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317534.555801:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317534.555808:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291738624/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317534.555835:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738624:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317534.556023:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00010000:00010000:1.0:1767317534.561075:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.562053:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738624:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317534.562112:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x14:0x0](ffff8c3c4857ba88) 00000080:00200000:1.0:1767317534.562225:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.562255:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.562346:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.562357:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.562367:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.562391:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738752:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.562492:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.577301:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738752:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.577353:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577369:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577383:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577396:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577409:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577417:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577425:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.577437:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291738752/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.577452:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577468:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317534.577477:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317534.577535:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317534.577544:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4c2 00000080:00010000:1.0:1767317534.577552:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.577556:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4c2 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317534.577559:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.577569:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.577601:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.577635:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317534.577641:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317534.577676:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.577741:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.577749:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.577761:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.577790:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738880:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.578084:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.593111:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291738880:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.593149:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593183:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593220:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593234:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593248:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593262:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593270:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593278:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.593291:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291738880/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.593304:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.593325:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677442/6 (0 0) 00000002:00010000:1.0:1767317534.593347:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.593410:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.593433:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.593444:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.593471:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739008:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.593602:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.597055:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739008:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317534.597092:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597107:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597122:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597136:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597150:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597159:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597167:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317534.597215:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1f80 x1853164291739008/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317534.597230:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597246:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677442/6 (0 0) 00000080:00200000:1.0:1767317534.597271:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317534.597371:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88) 00000080:00200000:1.0:1767317534.597382:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x6:0x0], updating i_size 4096 00000080:00010000:1.0:1767317534.597392:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) for remote lock 0x73c3d5cb1442d4d0 00000080:00010000:1.0:1767317534.597398:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) for lock 0x73c3d5cb1442d4c9 00000080:00010000:1.0:1767317534.597414:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) 00000080:00010000:1.0:1767317534.597417:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4c9 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.597422:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597433:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317534.597450:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d4d0 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317534.597453:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597460:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317534.597494:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff8c3c485e3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317534.597509:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88),name=d44d.sanity-flr 00000002:00010000:1.0:1767317534.597538:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.597548:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597559:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.597566:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.597571:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) 00000080:00010000:1.0:1767317534.597574:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) for lock 0x73c3d5cb1442d4d0 00000080:00010000:1.0:1767317534.597578:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4d0 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317534.597581:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597588:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.597653:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.597662:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.597670:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597679:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.597685:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.597689:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.597692:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4c2 00000080:00010000:1.0:1767317534.597702:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4c2 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317534.597705:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.597712:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.597721:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.597729:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44d.sanity-flr, flags=266 00000080:00200000:1.0:1767317534.597735:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88), inode mode 41ed mask 44 00000080:00200008:1.0:1767317534.597746:0:83367:0:(file.c:1001:ll_file_open()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff8c3c485e3a88), flags 704400 00000002:00010000:1.0:1767317534.597765:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317534.597843:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.597851:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317534.598608:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317534.598625:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291739264/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317534.598638:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.600777:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739264:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.601115:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.605140:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739264:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.605174:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605189:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605197:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605213:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605222:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605229:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.605234:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605241:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605248:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605256:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317534.605264:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.605271:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d4d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317534.605436:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1f80 x1853164291739264/t4294976306(4294976306) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317534.605452:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291739264/t4294976306(4294976306) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.605468:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.605499:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x6:0x0], updating i_size 4096 00000002:00100000:0.0:1767317534.605527:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291739264/t4294976306(4294976306) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.605624:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff8c3c485e3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.605634:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88),name=d44d.sanity-flr 00000002:00010000:0.0:1767317534.605665:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.605683:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.605793:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.605801:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.605809:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) 00000080:00010000:0.0:1767317534.605813:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff8c3c485e3a88) for lock 0x73c3d5cb1442d4d0 00000080:00010000:0.0:1767317534.605820:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4d0 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.605824:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.605832:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.606145:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317534.606163:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x240000402:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.606171:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.606181:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317534.606910:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739392:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317534.607059:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.639994:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739392:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317534.640739:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.640759:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.640825:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:0.0:1767317534.640851:0:83367:0:(file.c:424:ll_file_release()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff8c3c485e3a88), flags 704000 00000002:00100000:0.0:1767317534.640984:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291739264/t4294976306(4294976306) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317534.640998:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317534.641004:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291739648/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317534.641030:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739648:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317534.641172:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317534.649519:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291739648:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317534.649568:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291739264/t4294976306(4294976306) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.649656:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.649681:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.649716:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.649734:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.649744:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.649751:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.649755:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4c2 00000080:00010000:0.0:1767317534.649764:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4c2 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317534.649768:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.649779:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.649796:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.649809:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44d.sanity-flr, flags=0 00000080:00200000:0.0:1767317534.649817:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.649826:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.649832:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.650081:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.650091:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317534.650095:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.650098:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4c2 00000080:00010000:0.0:1767317534.650103:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4c2 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317534.650106:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.650114:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.650122:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317534.650129:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317534.650154:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.650217:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.650225:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.650250:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d4c9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72aa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.650278:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.650449:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291739776:192.168.202.133@tcp:103:rm.0 00010000:00010000:0.0:1767317534.651627:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.651656:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.651660:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d4d0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72ab6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317534.651963:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317534.651979:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e300 x1853164291740032/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317534.652006:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740032:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317534.652099:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317534.655626:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291739776:192.168.202.133@tcp:103:rm.0 00000100:00100000:2.0:1767317534.655778:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317534.656012:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379214464 00000100:00100000:3.0:1767317534.656023:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379214464 00000100:00100000:3.0:1767317534.656089:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9512 00000100:00100000:3.0:1767317534.656100:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379214464:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317534.656119:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.656222:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317534.656230:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379214464:12345-192.168.202.133@tcp:104: Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317534.656238:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9512 00010000:00010000:0.0:1767317534.656449:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.656458:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656468:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.656473:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656482:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656491:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656558:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656565:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.656618:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656626:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d4c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72a8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.656648:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.656650:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.656652:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.656710:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291740160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317534.671230:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291740160:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317534.709484:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740032:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317534.709546:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x6:0x0](ffff8c3c485e3a88) 00000080:00200000:0.0:1767317534.709651:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317534.709680:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.710063:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.710075:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.710088:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.710112:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740288:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.710260:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.718139:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740288:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.718183:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718205:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718244:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718257:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718272:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718280:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718288:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.718301:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291740288/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.718318:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718334:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317534.718343:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.718380:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317534.718388:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4de 00000080:00010000:0.0:1767317534.718395:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317534.718398:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4de from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317534.718402:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.718418:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.718451:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317534.718480:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317534.718485:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317534.718517:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44e.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.718571:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.718578:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.718588:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.718614:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740416:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.718721:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.728289:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740416:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.728337:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728365:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728373:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728410:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728424:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728438:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 5/2,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728447:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 5/2,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728454:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.728467:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291740416/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.728483:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.728494:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935620/1 (0 0) 00000080:00200000:0.0:1767317534.728503:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317534.728559:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8) 00000002:00010000:0.0:1767317534.728602:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.728671:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.728680:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.728710:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.728736:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740544:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.729118:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.739534:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740544:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.739565:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 4/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739581:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 4/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739595:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739607:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739621:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739630:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739638:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.739650:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291740544/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.739684:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739710:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/7 (0 0) 00010000:00010000:0.0:1767317534.739719:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.739727:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.739762:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.739820:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.739827:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.739836:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317534.740400:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740672:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317534.740517:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.743760:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740672:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.743793:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.743809:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.743848:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744116:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744134:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744143:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744151:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317534.744164:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9e680 x1853164291740672/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317534.744299:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744380:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/7 (0 0) 00010000:00010000:0.0:1767317534.744392:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744401:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.744453:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000404:0x1:0x0], updating i_size 8192 00000080:00010000:0.0:1767317534.744483:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) for lock 0x73c3d5cb1442d4e5 00000080:00010000:0.0:1767317534.744501:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) 00000080:00010000:0.0:1767317534.744505:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4e5 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317534.744510:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744518:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317534.744562:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff8c3c617363c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.744571:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8),name=d44e.sanity-flr 00000002:00010000:0.0:1767317534.744601:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.744612:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744624:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.744634:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.744640:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744648:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744655:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.744661:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.744678:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.744684:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746049:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746062:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746071:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.746089:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317534.746096:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) 00000080:00010000:0.0:1767317534.746101:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) for lock 0x73c3d5cb1442d4e5 00000080:00010000:0.0:1767317534.746107:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4e5 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317534.746111:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746118:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.746139:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.746149:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746157:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746594:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746602:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.746612:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.746620:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746629:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746637:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.746644:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.750298:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.750356:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.750378:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.750396:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.750405:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.750417:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.750422:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4de 00000080:00010000:2.0:1767317534.750456:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4de from it ffffa7f7c1c1fbf8 00010000:00010000:2.0:1767317534.750460:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.750471:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.750491:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.750502:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44e.sanity-flr, flags=266 00000080:00200000:2.0:1767317534.750512:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8), inode mode 41ed mask 44 00000080:00200008:2.0:1767317534.750522:0:83367:0:(file.c:1001:ll_file_open()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff8c3c617363c8), flags 704400 00000002:00010000:2.0:1767317534.750543:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767317534.750616:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317534.750625:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:2.0:1767317534.750640:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317534.750656:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39180 x1853164291740928/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317534.750667:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317534.751039:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740928:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317534.751413:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317534.758308:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291740928:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317534.758633:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758650:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758659:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758707:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758716:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758723:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.758728:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758735:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758742:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758749:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317534.758756:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317534.758762:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d4fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317534.758787:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c46a39180 x1853164291740928/t8589937375(8589937375) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317534.758802:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39180 x1853164291740928/t8589937375(8589937375) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317534.758822:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.758933:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000404:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767317534.758958:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a39180 x1853164291740928/t8589937375(8589937375) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.759051:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff8c3c617363c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.759060:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8),name=d44e.sanity-flr 00000002:00010000:0.0:1767317534.759085:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.759102:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759115:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.759126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.759133:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759141:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759150:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759158:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.759175:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.759182:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759191:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759219:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759226:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.759239:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317534.759246:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) 00000080:00010000:0.0:1767317534.759250:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff8c3c617363c8) for lock 0x73c3d5cb1442d4e5 00000080:00010000:0.0:1767317534.759254:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4e5 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.759258:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759264:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.759277:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.759283:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759291:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759298:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759305:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.759665:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.759672:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759680:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759770:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.759778:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.759819:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317534.759834:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.772922:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.772960:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.772983:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.782992:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741056:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.783154:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.795125:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741056:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317534.796043:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.796064:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317534.796099:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317534.796119:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.796714:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767317534.801032:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741184:192.168.202.133@tcp:37:rm.0 00000100:00100000:3.0:1767317534.801556:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1767317534.809756:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741184:192.168.202.133@tcp:37:rm.0 00010000:00010000:2.0:1767317534.810550:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.810594:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.810676:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:2.0:1767317534.810704:0:83367:0:(file.c:424:ll_file_release()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff8c3c617363c8), flags 704000 00000002:00100000:2.0:1767317534.810804:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a39180 x1853164291740928/t8589937375(8589937375) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317534.810818:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317534.810824:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b100 x1853164291741440/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317534.810856:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741440:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317534.811009:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767317534.816598:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741440:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317534.816659:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a39180 x1853164291740928/t8589937375(8589937375) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767317534.816763:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.816787:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.816811:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.816827:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.816845:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.816851:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.816936:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4de 00000080:00010000:2.0:1767317534.816946:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4de from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317534.816950:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.816960:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.816979:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317534.816993:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44e.sanity-flr, flags=0 00000080:00200000:2.0:1767317534.817001:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317534.817010:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317534.817017:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817026:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.817032:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317534.817036:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317534.817039:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d4de 00000080:00010000:2.0:1767317534.817042:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d4de from it ffffa7f7c1c1fd88 00010000:00010000:2.0:1767317534.817046:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817053:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317534.817062:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317534.817075:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317534.817100:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817343:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817392:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817401:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817407:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317534.817410:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d4e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b1f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.817426:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d4de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b03 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317534.817447:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317534.817456:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b100 x1853164291741696/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317534.817484:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741696:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317534.817630:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a13c3c0 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.825673:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.826075:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379216128 00000100:00100000:2.0:1767317534.826092:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379216128 00000100:00100000:2.0:1767317534.826162:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9513 00000100:00100000:2.0:1767317534.826174:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379216128:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.826221:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.827035:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.827051:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379216128:12345-192.168.202.133@tcp:104: Request processed in 877us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317534.827063:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9513 00010000:00010000:0.0:1767317534.827294:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.827307:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827332:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.827339:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827350:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827360:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827503:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827511:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.827552:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 1/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827559:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d4ec lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b2d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.827589:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.827592:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.827594:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317534.827809:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291741824:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317534.835440:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317534.835631:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379216384 00000100:00100000:2.0:1767317534.835646:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379216384 00000100:00100000:2.0:1767317534.835715:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9514 00000100:00100000:2.0:1767317534.835727:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379216384:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317534.835750:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317534.835857:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317534.835865:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379216384:12345-192.168.202.133@tcp:104: Request processed in 140us (440us total) trans 0 rc 0/0 00010000:00010000:0.0:1767317534.836095:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317534.836104:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836114:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317534.836120:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836129:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836139:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836283:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836313:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317534.836346:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836354:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d4f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b3b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.836376:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.836378:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317534.836380:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317534.836419:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291741952:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317534.836724:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9514 00000100:00100000:1.0:1767317534.839248:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291741824:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317534.845525:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291741952:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317534.853665:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291741696:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317534.853729:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000404:0x1:0x0](ffff8c3c617363c8) 00000080:00200000:3.0:1767317534.853849:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317534.853922:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.854003:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.854037:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.854049:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.854074:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742080:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.854188:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.858111:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742080:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.858148:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858164:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858179:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858192:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858215:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858224:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858233:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.858277:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1180 x1853164291742080/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.858294:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858310:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1767317534.858399:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317534.858435:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1767317534.858443:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d501 00000080:00010000:3.0:1767317534.858450:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317534.858453:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d501 from it ffffa7f7c1c1fb58 00010000:00010000:3.0:1767317534.858457:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.858465:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.858493:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317534.858520:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:3.0:1767317534.858525:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317534.858556:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d45.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.858628:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.858637:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.858647:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.858680:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742208:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.858799:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.865146:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742208:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.865182:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865223:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865233:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865247:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865262:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865275:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865285:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.865293:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.865308:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1180 x1853164291742208/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.866865:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.866902:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/1 (0 0) 00000002:00010000:3.0:1767317534.866928:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.866996:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.867006:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.867016:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.867048:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742336:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.867171:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.873278:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742336:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.873390:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873406:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873419:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873432:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873473:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873483:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873492:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.873506:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1880 x1853164291742336/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/672 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.873524:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.873542:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/1 (0 0) 00000080:00200000:3.0:1767317534.873568:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317534.874657:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000002:00010000:3.0:1767317534.874694:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.874768:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.874779:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.874790:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.874823:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742464:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.875035:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.881485:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742464:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.881512:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881522:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881533:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881542:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881552:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881559:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881564:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.881580:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1180 x1853164291742464/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.881592:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881605:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677443/2 (0 0) 00010000:00010000:3.0:1767317534.881612:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.881637:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.881667:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.881727:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.881734:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.881743:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.881768:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742592:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.882090:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.894398:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742592:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.894433:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894447:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894461:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894473:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894487:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894518:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894525:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317534.894538:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1180 x1853164291742592/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317534.894554:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894694:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935617/5 (0 0) 00010000:00010000:3.0:1767317534.894708:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894717:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.894764:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1:0x0], updating i_size 8192 00000080:00010000:3.0:1767317534.894780:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for remote lock 0x73c3d5cb1442d50f 00000080:00010000:3.0:1767317534.894787:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d508 00000080:00010000:3.0:1767317534.894803:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000080:00010000:3.0:1767317534.894808:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d508 from it ffffa7f7c1c1fb20 00010000:00010000:3.0:1767317534.894811:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894819:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1767317534.894839:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d50f from it ffffa7f7c1c1fb20 00010000:00010000:3.0:1767317534.894843:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.894852:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767317534.895058:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317534.895069:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88),name=d45.sanity-flr 00000002:00010000:3.0:1767317534.895106:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895119:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895133:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.895142:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895148:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895156:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895163:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895169:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.895191:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895206:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895214:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895221:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895227:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.895236:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767317534.895242:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000080:00010000:3.0:1767317534.895245:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d50f 00000080:00010000:3.0:1767317534.895249:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d50f from it ffffa7f7c1c1fcb8 00010000:00010000:3.0:1767317534.895252:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895260:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.895270:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895275:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895282:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895295:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895302:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.895310:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895505:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895517:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895526:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895533:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.895699:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317534.895711:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317534.895721:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895729:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.895736:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317534.895741:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317534.895751:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d501 00000080:00010000:3.0:1767317534.895755:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d501 from it ffffa7f7c1c1fbf8 00010000:00010000:3.0:1767317534.895759:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.895765:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317534.895773:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317534.895781:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=266 00000080:00200000:3.0:1767317534.895788:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 44 00000080:00200008:3.0:1767317534.895799:0:83367:0:(file.c:1001:ll_file_open()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags 704400 00000002:00010000:3.0:1767317534.895818:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1767317534.895920:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.895929:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:3.0:1767317534.895944:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317534.895955:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1880 x1853164291742848/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317534.895965:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317534.895991:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742848:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317534.896350:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317534.915826:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742848:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317534.916116:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916253:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916262:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916270:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916279:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916286:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:3.0:1767317534.916292:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916299:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916308:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916315:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767317534.916323:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317534.916330:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:3.0:1767317534.916366:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c58fc1880 x1853164291742848/t4294976311(4294976311) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317534.916381:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1880 x1853164291742848/t4294976311(4294976311) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317534.916407:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317534.916659:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767317534.916759:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc1880 x1853164291742848/t4294976311(4294976311) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317534.917255:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317534.917266:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88),name=d45.sanity-flr 00000002:00010000:0.0:1767317534.917296:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.917314:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917329:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.917340:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.917346:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917364:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917375:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917383:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.917403:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.917411:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917419:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917427:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917434:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.917445:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317534.917453:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000080:00010000:0.0:1767317534.917457:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d50f 00000080:00010000:0.0:1767317534.917462:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d50f from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317534.917466:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917483:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.917498:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.917503:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917510:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917517:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917524:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.917531:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317534.917536:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917542:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917549:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917556:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317534.917601:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317534.917614:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317534.917640:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317534.917646:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317534.917654:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317534.923375:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742976:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317534.923599:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1767317534.952122:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291742976:192.168.202.133@tcp:37:rm.0 00010000:00010000:3.0:1767317534.952900:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.952921:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317534.952951:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767317534.952969:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.952983:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767317534.953609:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743104:192.168.202.133@tcp:37:rm.0 00000100:00100000:3.0:1767317534.953760:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1767317534.977357:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743104:192.168.202.133@tcp:37:rm.0 00010000:00010000:3.0:1767317534.979695:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317534.979722:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767317534.980335:0:83367:0:(file.c:424:ll_file_release()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags 704000 00000002:00100000:2.0:1767317534.980443:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc1880 x1853164291742848/t4294976311(4294976311) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317534.980460:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317534.980466:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39180 x1853164291743360/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317534.980498:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743360:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317534.980639:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767317534.998815:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743360:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317534.999057:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc1880 x1853164291742848/t4294976311(4294976311) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317534.999184:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317534.999223:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317534.999247:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.999264:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.999274:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317534.999281:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317534.999287:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d501 00000080:00010000:1.0:1767317534.999297:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d501 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317534.999302:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317534.999311:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317534.999332:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317534.999341:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=266 00000080:00200000:1.0:1767317534.999350:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 44 00000080:00200008:1.0:1767317534.999362:0:83367:0:(file.c:1001:ll_file_open()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags 704400 00000002:00010000:1.0:1767317534.999380:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317534.999478:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317534.999486:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317534.999500:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317534.999508:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291743616/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317534.999518:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317534.999546:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743616:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317534.999846:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.006386:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743616:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.006442:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.006455:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.006469:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.006481:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.006496:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1180 x1853164291743616/t4294976313(4294976313) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.006537:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291743616/t4294976313(4294976313) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.006556:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.006567:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/1 (0 0) 00000080:00200000:1.0:1767317535.006575:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317535.007549:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317535.007568:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d52b 00000080:00010000:2.0:1767317535.007581:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d52b from it ffffa7f7c1c1fbd0 00010000:00010000:2.0:1767317535.007587:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.007601:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317535.007642:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291743616/t4294976313(4294976313) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767317535.007762:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317535.007772:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88),name=d45.sanity-flr 00000002:00010000:2.0:1767317535.007802:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.007818:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008265:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008284:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.008293:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008303:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008313:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008342:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008355:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.008364:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008374:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008383:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008391:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.008405:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317535.008413:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000080:00010000:2.0:1767317535.008418:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1:0x0](ffff8c3c597ddb88) for lock 0x73c3d5cb1442d50f 00000080:00010000:2.0:1767317535.008423:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d50f from it ffffa7f7c1c1fcd8 00010000:00010000:2.0:1767317535.008426:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008434:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008447:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.008453:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008469:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008478:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008486:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008495:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.008501:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008508:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008515:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008522:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.008569:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88) pos/size0/8192 32bit_api 0 00010000:00010000:2.0:1767317535.008585:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008613:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317535.008620:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008639:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:2.0:1767317535.008654:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:2.0:1767317535.008658:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.008666:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.008678:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317535.009456:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.009475:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:2.0:1767317535.009492:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:2.0:1767317535.009496:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.009505:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.009572:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:2.0:1767317535.009608:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 1 00000080:00200000:2.0:1767317535.009628:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f45.sanity-flr, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags=0 00000080:00200000:2.0:1767317535.009634:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f45.sanity-flr, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), intent=getattr 00000002:00010000:2.0:1767317535.009664:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f45.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.010642:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317535.010658:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317535.010673:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317535.010722:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743744:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317535.010892:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c50a3f9c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.018634:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291743744:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.018678:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018722:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018731:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018745:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018761:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018774:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018811:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.018819:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.018849:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a38700 x1853164291743744/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1624 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.019180:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1040 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.019208:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.019222:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/3 (0 0) 00000080:00200000:0.0:1767317535.019233:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.019282:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x3:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317535.019422:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x3:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:0.0:1767317535.019429:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d532 00000080:00010000:0.0:1767317535.019443:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x3:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.019447:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d532 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317535.019450:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.019460:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.019515:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.019525:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f45.sanity-flr, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88) 00010000:00010000:0.0:1767317535.019567:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.019665:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.019677:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x3:0x0]: losing layout lock 00010000:00010000:0.0:1767317535.020412:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.020425:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.020431:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.020435:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1e00/0x73c3d5cb1442d532 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c06 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.020457:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90200/0x73c3d5cb1442d51d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bc7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.020481:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.020494:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9e680 x1853164291744000/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.020524:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744000:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.020652:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.033128:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744000:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.033572:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317535.033589:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x3:0x0]: flr state: 1, move mirror from 3 to 3, have retried: 0, mirror count: 4 00020000:00200000:0.0:1767317535.033593:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317535.033601:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[7] flags 0x16 00020000:00200000:0.0:1767317535.033623:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[8] flags 0x6 00000080:00200000:0.0:1767317535.033651:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317535.033660:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x3:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317535.034666:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.034712:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags=0 00000080:00200000:0.0:1767317535.034719:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), intent=getattr 00000002:00010000:0.0:1767317535.034749:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f45.sanity-flr.copy,[0x0:0x0:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.034827:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.034854:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.034895:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.034929:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744128:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.035060:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.039823:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744128:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.039902:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.039930:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.039964:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.039978:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.039991:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.040006:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.040014:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.040021:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.040033:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291744128/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/1624 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.040047:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1040 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.040062:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.040072:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/3 (0 0) 00000080:00200000:0.0:1767317535.040080:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000403:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.040128:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x3:0x0](ffff8c3c61737448) 00000080:00200000:2.0:1767317535.047594:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x3:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:2.0:1767317535.047617:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x3:0x0](ffff8c3c61737448) for lock 0x73c3d5cb1442d539 00000080:00010000:2.0:1767317535.047634:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x3:0x0](ffff8c3c61737448) 00000080:00010000:2.0:1767317535.047638:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d539 from it ffffa7f7c1c1fdf8 00010000:00010000:2.0:1767317535.047647:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317535.047662:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317535.047808:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 3 00000080:00200000:2.0:1767317535.047819:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88) 00010000:00010000:2.0:1767317535.048386:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.048497:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317535.048530:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x3:0x0]: losing layout lock 00010000:00010000:2.0:1767317535.048579:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317535.048586:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.048592:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317535.048594:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d539 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c3e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317535.048613:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91800/0x73c3d5cb1442d516 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bb9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317535.048635:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317535.048652:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39880 x1853164291744384/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317535.049588:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744384:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317535.049741:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317535.060520:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744384:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317535.060597:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317535.060636:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x3:0x0]: flr state: 1, move mirror from 3 to 3, have retried: 0, mirror count: 4 00020000:00200000:3.0:1767317535.060640:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317535.060647:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[7] flags 0x16 00020000:00200000:3.0:1767317535.060665:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[8] flags 0x6 00000080:00200000:3.0:1767317535.060691:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317535.060699:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x3:0x0](ffff8c3c61737448) 00000080:00200000:3.0:1767317535.060833:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 1 00000080:00200000:3.0:1767317535.063459:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=template, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags=0 00000080:00200000:3.0:1767317535.063476:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=template, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88), intent=getattr 00000002:00010000:3.0:1767317535.063516:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: template,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317535.063601:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317535.063613:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317535.063623:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317535.063656:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744512:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317535.063794:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317535.071466:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744512:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317535.071501:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071541:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071550:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071585:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071597:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071611:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071621:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.071628:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317535.071642:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1180 x1853164291744512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317535.071657:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317535.071672:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317535.071696:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/2 (0 0) 00000080:00200000:3.0:1767317535.071706:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317535.071750:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x2:0x0](ffff8c3c597dc2c8) 00000080:00200000:3.0:1767317535.071854:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x2:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1767317535.071896:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x2:0x0](ffff8c3c597dc2c8) for lock 0x73c3d5cb1442d540 00000080:00010000:3.0:1767317535.071917:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x2:0x0](ffff8c3c597dc2c8) 00000080:00010000:3.0:1767317535.071921:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d540 from it ffffa7f7c1c1fdf8 00010000:00010000:3.0:1767317535.071925:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317535.071935:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317535.071977:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88), inode mode 41ed mask 3 00000080:00200000:3.0:1767317535.071988:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=template, dir=[0x240000404:0x1:0x0](ffff8c3c597ddb88) 00010000:00010000:3.0:1767317535.072035:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317535.072054:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x2:0x0]: losing layout lock 00010000:00010000:3.0:1767317535.072102:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317535.072110:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317535.072113:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d540 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72c76 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767317535.072149:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317535.072156:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1180 x1853164291744768/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317535.072184:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744768:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317535.072319:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebe40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317535.084166:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291744768:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317535.084267:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317535.084305:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317535.084343:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317535.084353:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x2:0x0](ffff8c3c597dc2c8) 00000080:00200008:3.0:1767317535.084459:0:83367:0:(file.c:424:ll_file_release()) START file d45.sanity-flr:[0x240000404:0x1:0x0](ffff8c3c597ddb88), flags 704000 00010000:00010000:3.0:1767317535.084492:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317535.084541:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317535.084562:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317535.084573:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084584:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317535.084592:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317535.084599:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317535.084603:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d501 00000080:00010000:3.0:1767317535.084611:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d501 from it ffffa7f7c1c1fc10 00010000:00010000:3.0:1767317535.084615:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084625:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317535.084644:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317535.084656:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=0 00000080:00200000:3.0:1767317535.084662:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317535.084667:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317535.084672:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084686:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317535.084692:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317535.084696:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317535.084698:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d501 00000080:00010000:3.0:1767317535.084702:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d501 from it ffffa7f7c1c1fd88 00010000:00010000:3.0:1767317535.084704:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084711:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317535.084718:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767317535.084724:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:3.0:1767317535.084745:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084793:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084800:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317535.084838:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d508 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72b9d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.084911:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317535.084954:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1180 x1853164291743616/t4294976313(4294976313) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317535.084974:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317535.084980:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3480 x1853164291745152/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317535.085002:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745152:192.168.202.133@tcp:35:rm.0 00000100:00100000:3.0:1767317535.085106:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1767317535.085698:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291744896:192.168.202.133@tcp:103:rm.0 00000100:00100000:3.0:1767317535.089411:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291744896:192.168.202.133@tcp:103:rm.0 00000100:00100000:3.0:1767317535.094637:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745152:192.168.202.133@tcp:35:rm.0 00000002:00100000:3.0:1767317535.094697:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1180 x1853164291743616/t4294976313(4294976313) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317551 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767317535.094766:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.094826:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.094835:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.094842:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317535.094846:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d52b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72be3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.094868:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d50f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72bab expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317535.094991:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317535.095014:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3480 x1853164291745408/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317535.095042:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745408:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.096006:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317535.100235:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.100682:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379217664 00000100:00100000:3.0:1767317535.100709:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379217664 00000100:00100000:3.0:1767317535.100784:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9515 00000100:00100000:3.0:1767317535.100798:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379217664:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.100823:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.101271:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.101280:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379217664:12345-192.168.202.133@tcp:104: Request processed in 486us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.101289:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9515 00010000:00010000:0.0:1767317535.101360:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317535.101371:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101381:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c90800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.101387:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101396:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101405:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101476:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101484:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.101520:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101527:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90800/0x73c3d5cb1442d501 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72b81 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.101552:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.101554:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.101556:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.101566:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317535.101584:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291745536:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.111558:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291745536:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.137044:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745408:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.137109:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x1:0x0](ffff8c3c597ddb88) 00000080:00200000:0.0:1767317535.137255:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.137285:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.137368:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.137379:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.137391:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.137416:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745664:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.137543:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.142163:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745664:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.142217:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142231:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142246:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142259:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142297:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142306:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142314:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.142327:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f800 x1853164291745664/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.142343:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142359:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317535.142367:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.142405:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.142413:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d547 00000080:00010000:0.0:1767317535.142419:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.142423:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d547 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317535.142426:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.142435:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.142469:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.142504:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317535.142509:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317535.142541:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d46.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.142596:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.142604:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.142616:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.142641:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745792:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.142750:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.149974:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745792:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.150010:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150040:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150050:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150065:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150079:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150120:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150142:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150152:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.150166:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f800 x1853164291745792/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.150184:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.150206:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/4 (0 0) 00000080:00200000:0.0:1767317535.150215:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.150274:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00000002:00010000:0.0:1767317535.150311:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.150377:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.150385:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.150394:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.150418:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745920:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.150527:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.154024:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291745920:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.154055:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154069:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154083:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154095:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154108:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154117:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154125:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.154146:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291745920/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.154162:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154183:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/8 (0 0) 00010000:00010000:0.0:1767317535.154192:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.154229:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.154268:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.154336:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.154344:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.154354:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.154380:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746048:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.154485:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.160638:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746048:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.160674:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160701:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160717:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160731:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160745:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160774:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160782:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.160796:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9df80 x1853164291746048/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.160813:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.160842:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/8 (0 0) 00010000:00010000:0.0:1767317535.160852:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162087:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.162439:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4:0x0], updating i_size 8192 00000080:00010000:0.0:1767317535.162457:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d54e 00000080:00010000:0.0:1767317535.162476:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.162481:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d54e from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317535.162486:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162496:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317535.162566:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.162575:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8),name=d46.sanity-flr 00000002:00010000:0.0:1767317535.162608:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.162625:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162639:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.162652:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.162659:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162667:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162676:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162698:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.162710:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.162718:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162726:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162746:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162754:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.162765:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317535.162772:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.162775:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d54e 00000080:00010000:0.0:1767317535.162779:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d54e from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317535.162783:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162790:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.162804:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.162810:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162818:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.162826:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.163604:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.163657:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.163667:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.164364:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.164377:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.164384:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.164471:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.164492:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.164502:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.164511:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.164519:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.164526:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.164530:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d547 00000080:00010000:0.0:1767317535.164536:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d547 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317535.164539:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.164561:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.164571:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.164580:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=266 00000080:00200000:0.0:1767317535.164589:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317535.164599:0:83367:0:(file.c:1001:ll_file_open()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), flags 704400 00000002:00010000:0.0:1767317535.164620:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317535.164782:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.164790:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.164806:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.164822:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f800 x1853164291746304/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.165309:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.165343:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746304:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.165612:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.170726:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746304:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.170758:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.170776:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.170809:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.170817:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.170827:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.171070:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58cccc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.171076:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.171085:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.171094:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.171102:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.171111:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.171119:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.171433:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c50e9f800 x1853164291746304/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.171449:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f800 x1853164291746304/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.171469:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.171519:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.171538:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f800 x1853164291746304/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.171624:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.171633:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8),name=d46.sanity-flr 00000002:00010000:0.0:1767317535.171657:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.171674:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.171769:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.171784:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.171790:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.171798:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.171807:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.171815:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.172057:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.172067:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172089:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172097:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172105:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.172116:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317535.172124:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.172128:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d54e 00000080:00010000:0.0:1767317535.172142:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d54e from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.172145:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172153:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.172165:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.172231:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172240:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172248:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172265:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.172274:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.172279:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172286:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172294:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172301:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.172337:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317535.172351:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.172376:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.172383:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.172390:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.174557:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746432:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.174852:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.188555:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746432:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.189528:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.189551:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.189582:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.189601:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.189616:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.190552:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746560:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.191057:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.202289:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746560:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.203067:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.203088:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.203179:0:83367:0:(file.c:424:ll_file_release()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), flags 704000 00000002:00100000:1.0:1767317535.203282:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9f800 x1853164291746304/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.203298:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.203305:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291746816/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.203334:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746816:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.203458:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.207771:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291746816:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.207828:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9f800 x1853164291746304/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.207985:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.208009:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.208030:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.208044:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.208051:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.208073:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.208077:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d547 00000080:00010000:1.0:1767317535.208085:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d547 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317535.208088:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.208095:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.208110:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.208117:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=266 00000080:00200000:1.0:1767317535.208125:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.208284:0:83367:0:(file.c:1001:ll_file_open()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), flags 704400 00000002:00010000:1.0:1767317535.208304:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317535.208404:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.208411:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.208421:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.208426:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291747072/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.208433:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.208453:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747072:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.208686:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.211538:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747072:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.211607:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.211620:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.211634:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.211648:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.211664:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1180 x1853164291747072/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.211678:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291747072/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.211697:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.211711:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/4 (0 0) 00000080:00200000:1.0:1767317535.211719:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.211762:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.211770:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d56a 00000080:00010000:1.0:1767317535.211780:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d56a from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317535.211785:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.211795:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.211834:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291747072/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.211969:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.211977:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8),name=d46.sanity-flr 00000002:00010000:1.0:1767317535.212002:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212014:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212027:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212036:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212041:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212046:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212051:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212055:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212061:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212067:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212080:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212085:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212089:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.212097:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.212101:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) 00000080:00010000:1.0:1767317535.212104:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d54e 00000080:00010000:1.0:1767317535.212107:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d54e from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.212109:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212113:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212121:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212124:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212128:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212363:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212378:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212385:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212389:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212394:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212399:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212403:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.212438:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317535.212447:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212468:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.212471:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212476:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.212488:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.212491:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212499:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.212506:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.212509:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212513:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.212523:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.212525:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.212529:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.212564:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767317535.212592:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.212608:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=dir.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:1.0:1767317535.212613:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=dir.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), intent=getattr 00000002:00010000:1.0:1767317535.212626:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dir.copy,[0x0:0x0:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.212677:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.212681:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.212693:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.212731:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747200:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.214621:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.219023:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747200:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.219064:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219095:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219103:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219116:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219287:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219305:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219314:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219333:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.219347:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291747200/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.219382:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.219395:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 8589935621/9 (0 0) 00000002:00010000:1.0:1767317535.219419:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.219495:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.219503:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.219513:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.219542:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747328:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.219671:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.227247:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747328:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.227281:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227323:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227345:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227359:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227402:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227408:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227413:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.227421:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1f80 x1853164291747328/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/672 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.227433:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.227444:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/9 (0 0) 00000080:00200000:1.0:1767317535.227468:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.227521:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88) 00000002:00010000:1.0:1767317535.227545:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.227592:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.227597:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.227604:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.227624:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747456:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.227724:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.231304:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747456:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.231341:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 4/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231352:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 4/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231363:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231372:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231381:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 5/2,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231387:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 5/2,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231392:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.231399:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291747456/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.231410:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231422:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/10 (0 0) 00010000:00010000:1.0:1767317535.231427:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.231448:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.231479:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.231529:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.231534:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.231541:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.231559:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747584:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.231638:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.235145:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747584:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.235256:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 4/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235273:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235286:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235300:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235313:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235346:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235354:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.235368:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291747584/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.235386:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235402:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/10 (0 0) 00010000:00010000:1.0:1767317535.235410:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235419:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.235462:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x9:0x0], updating i_size 8192 00000080:00010000:1.0:1767317535.235477:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) for remote lock 0x73c3d5cb1442d578 00000080:00010000:1.0:1767317535.235483:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d571 00000080:00010000:1.0:1767317535.235498:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) 00000080:00010000:1.0:1767317535.235501:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d571 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317535.235505:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235512:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317535.235527:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d578 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317535.235531:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235538:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.235572:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file dir.copy:[0x200000405:0x9:0x0](ffff8c3c485e5b88), request_mask 2047, flags 0, foreign 0 00000002:00010000:1.0:1767317535.235612:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.235624:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235635:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.235652:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.235656:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235662:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.235672:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.235679:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235700:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.235722:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.235726:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.235733:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.237430:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88),name=dir.copy 00000002:00010000:2.0:1767317535.237479:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x9:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.237498:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237513:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.237539:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.237547:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237556:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237567:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237578:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.237597:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.237605:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237614:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237622:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237629:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.237641:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317535.237651:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) 00000080:00010000:2.0:1767317535.237656:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d578 00000080:00010000:2.0:1767317535.237667:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d578 from it ffffa7f7c1c1fcb8 00010000:00010000:2.0:1767317535.237671:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237680:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.237708:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.237714:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237723:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237731:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237739:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.237747:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.237752:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237760:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237768:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.237789:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.238213:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317535.238225:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir.copy, flags=258 00000080:00200000:2.0:1767317535.238241:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88), inode mode 41ed mask 44 00000080:00200008:2.0:1767317535.238253:0:83367:0:(file.c:1001:ll_file_open()) START file dir.copy:[0x200000405:0x9:0x0](ffff8c3c485e5b88), flags 704400 00000002:00010000:2.0:1767317535.238276:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x9:0x0]) in obj [0x200000405:0x9:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767317535.238352:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317535.238360:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:2.0:1767317535.238375:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767317535.238391:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3aa00 x1853164291747840/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767317535.238401:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317535.238427:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747840:192.168.202.133@tcp:101:rm.0 00000002:00010000:3.0:1767317535.239089:0:83374:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767317535.239108:0:83374:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.239120:0:83374:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:3.0:1767317535.239138:0:83374:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:3.0:1767317535.239142:0:83374:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.239150:0:83374:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317535.239176:0:83374:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767317535.239185:0:83374:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.239202:0:83374:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:3.0:1767317535.239215:0:83374:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:3.0:1767317535.239218:0:83374:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.239225:0:83374:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.239301:0:83374:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83374 initiator: MDT0 00010000:00010000:3.0:1767317535.239308:0:83374:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83374 initiator: MDT0 00010000:00010000:3.0:1767317535.239338:0:83374:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83374 initiator: MDT0 00010000:00010000:3.0:1767317535.239344:0:83374:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83374 initiator: MDT0 00010000:00010000:3.0:1767317535.239362:0:83374:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83374 initiator: MDT0 00010000:00010000:3.0:1767317535.239368:0:83374:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83374 initiator: MDT0 00000100:00100000:3.0:1767317535.239479:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291748096:192.168.202.133@tcp:63:ll_sa.0 00000100:00100000:2.0:1767317535.240235:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291747968:192.168.202.133@tcp:63:ll_sa.0 00000100:00100000:0.0:1767317535.241040:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 12 seconds 00010000:00010000:3.0:1767317535.248789:0:2520:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249161:0:2520:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249172:0:2520:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249187:0:2520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249209:0:2520:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249222:0:2520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249230:0:2520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.249238:0:2520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317535.249257:0:2520:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1880 x1853164291748096/t0(0) o63->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:24/4 lens 680/1176 e 0 to 0 dl 1767317552 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:3.0:1767317535.249270:0:2520:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1767317535.249301:0:2520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d594 from it ffff8c3c58db1588 00010000:00010000:3.0:1767317535.249305:0:2520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317535.249313:0:2520:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1767317535.249357:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291748096:192.168.202.133@tcp:63:ll_sa.0 00010000:00010000:3.0:1767317535.249415:0:51684:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317535.249450:0:51684:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x6:0x0](ffff8c3c597dc2c8) 00000080:00200000:3.0:1767317535.249552:0:51684:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x6:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:3.0:1767317535.249560:0:51684:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x6:0x0](ffff8c3c597dc2c8) for lock 0x73c3d5cb1442d594 00010000:00010000:2.0:1767317535.249827:0:2519:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249844:0:2519:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249911:0:2519:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249920:0:2519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249929:0:2519:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249938:0:2519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249944:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249951:0:2519:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317535.249962:0:2519:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc2a00 x1853164291747968/t0(0) o63->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:24/4 lens 1064/1656 e 0 to 0 dl 1767317552 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:2.0:1767317535.249973:0:2519:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d59b from it ffff8c3c58db2588 00010000:00010000:2.0:1767317535.249976:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.249984:0:2519:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250007:0:2519:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250026:0:2519:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250033:0:2519:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250041:0:2519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250048:0:2519:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250058:0:2519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250064:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.250071:0:2519:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317535.250081:0:2519:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc2a00 x1853164291747968/t0(0) o63->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:24/4 lens 1064/1656 e 0 to 0 dl 1767317552 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:2.0:1767317535.250090:0:2519:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1767317535.250101:0:2519:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5a2 from it ffff8c3c58db2988 00010000:00010000:2.0:1767317535.250104:0:2519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317535.250118:0:2519:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1767317535.250137:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291747968:192.168.202.133@tcp:63:ll_sa.0 00010000:00010000:2.0:1767317535.250166:0:74535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.250205:0:74535:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88) 00000002:00010000:2.0:1767317535.250233:0:74535:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.250298:0:74535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 74535 initiator: MDT0 00010000:00010000:2.0:1767317535.250308:0:74535:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74535 initiator: MDT0 00010000:00010000:2.0:1767317535.250318:0:74535:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74535 initiator: MDT0 00000100:00100000:2.0:1767317535.250346:0:74535:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job kworker/2:2:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:74535:1853164291748224:192.168.202.133@tcp:101:kworker.0 00000100:00100000:2.0:1767317535.250455:0:74535:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00010000:00010000:2.0:1767317535.250481:0:11272:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317535.250498:0:11272:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x7:0x0](ffff8c3c4857ec08) 00000080:00200000:2.0:1767317535.250565:0:11272:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x7:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:2.0:1767317535.250570:0:11272:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7:0x0](ffff8c3c4857ec08) for lock 0x73c3d5cb1442d5a2 00000080:00010000:3.0:1767317535.250805:0:51684:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d594 from it ffff8c3c58db1588 00010000:00010000:3.0:1767317535.250813:0:51684:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317535.250822:0:51684:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1767317535.254233:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291747840:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.254286:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254303:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254312:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254319:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 3/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254329:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254335:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.254341:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254350:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 4/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254358:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 5/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254365:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.254372:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 3/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.254379:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d58d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.254402:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c46a3aa00 x1853164291747840/t8589937385(8589937385) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.254429:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3aa00 x1853164291747840/t8589937385(8589937385) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.254452:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x9:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.254495:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x9:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.254520:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c46a3aa00 x1853164291747840/t8589937385(8589937385) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.254619:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file dir.copy:[0x200000405:0x9:0x0](ffff8c3c485e5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.254630:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88),name=dir.copy 00000002:00010000:0.0:1767317535.254662:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x9:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.254680:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254694:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.254706:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.254713:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254721:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254730:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254739:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.254770:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.254779:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254788:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254796:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254803:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.254814:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317535.254821:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) 00000080:00010000:0.0:1767317535.254826:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d578 00000080:00010000:0.0:1767317535.254831:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d578 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.254834:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254842:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.254854:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.254859:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254867:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254956:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254964:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.254974:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.254981:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254988:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.254995:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.255001:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.255037:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317535.255052:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.255079:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.255085:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.255094:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.255792:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291748352:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.255943:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000080:00200000:1.0:1767317535.258183:0:83375:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317535.258213:0:83375:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317535.258217:0:83375:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317535.258222:0:83375:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x240000404:0x6:0x0] 00000008:00010000:1.0:1767317535.258252:0:83375:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1767317535.258258:0:83375:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c89b0, osc lock ffff8c3c60dd1c80, flags 0x400000400041012 00010000:00010000:1.0:1767317535.258346:0:83375:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.258359:0:83375:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400041010 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.258377:0:83375:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c437c1f80 x1853164291748480/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00010000:1.0:1767317535.258424:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317535.258428:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317535.258432:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c89b0 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317535.258436:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317535.258439:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c89b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317535.258452:0:83375:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00010000:2.0:1767317535.258654:0:11272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5a2 from it ffff8c3c58db2988 00010000:00010000:2.0:1767317535.258666:0:11272:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317535.258696:0:11272:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1767317535.259334:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291748480:192.168.202.133@tcp:101:ll_agl.0 00000080:00200000:1.0:1767317535.260645:0:83375:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767317535.260665:0:83375:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317535.260668:0:83375:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317535.260672:0:83375:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x7:0x0] 00000008:00010000:1.0:1767317535.260731:0:83375:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1767317535.260736:0:83375:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c89b0, osc lock ffff8c3c60dd1c80, flags 0x400000400041012 00010000:00010000:1.0:1767317535.260825:0:83375:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.260839:0:83375:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400041010 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->16777215] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.260867:0:83375:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c437c2d80 x1853164291748608/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00010000:1.0:1767317535.261122:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767317535.261126:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317535.261130:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c89b0 (ffff8c3c547fdf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317535.261135:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c42ead918 (ffff8c3c5a0842d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317535.261138:0:83375:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c89b0 (ffff8c3c5a0842d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317535.261152:0:83375:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1767317535.261341:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291748608:192.168.202.133@tcp:101:ll_agl.0 00000100:00100000:2.0:1767317535.269475:0:74535:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job kworker/2:2:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:74535:1853164291748224:192.168.202.133@tcp:101:kworker.0 00010000:00010000:2.0:1767317535.269508:0:74535:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269523:0:74535:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269537:0:74535:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269550:0:74535:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269565:0:74535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269573:0:74535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269582:0:74535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317535.269595:0:74535:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291748224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317535.269636:0:74535:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269653:0:74535:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/9 (0 0) 00010000:00010000:2.0:1767317535.269662:0:74535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.269672:0:74535:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317535.269712:0:74535:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317535.269774:0:74535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 74535 initiator: MDT0 00010000:00010000:2.0:1767317535.269781:0:74535:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74535 initiator: MDT0 00010000:00010000:2.0:1767317535.269790:0:74535:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74535 initiator: MDT0 00000100:00100000:2.0:1767317535.269812:0:74535:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job kworker/2:2:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:74535:1853164291748736:192.168.202.133@tcp:101:kworker.0 00010000:00010000:0.0:1767317535.269992:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->16777215] (req 0->16777215) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270006:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270021:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270031:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317535.270050:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270067:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270073:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270094:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.270102:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317535.270116:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291748608:192.168.202.133@tcp:101:ll_agl.0 00000100:00100000:2.0:1767317535.270450:0:74535:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317535.276470:0:74535:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job kworker/2:2:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:74535:1853164291748736:192.168.202.133@tcp:101:kworker.0 00010000:00010000:2.0:1767317535.276504:0:74535:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 4/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276518:0:74535:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 4/1,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276557:0:74535:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276571:0:74535:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276585:0:74535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276593:0:74535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276602:0:74535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317535.276615:0:74535:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291748736/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317535.276632:0:74535:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276648:0:74535:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/9 (0 0) 00010000:00010000:2.0:1767317535.276656:0:74535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.276665:0:74535:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317535.277120:0:74535:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8:0x0], updating i_size 8192 00000080:00010000:2.0:1767317535.277147:0:74535:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff8c3c4857db88) for lock 0x73c3d5cb1442d59b 00000080:00010000:2.0:1767317535.277156:0:74535:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d59b from it ffff8c3c58db2588 00010000:00010000:2.0:1767317535.277161:0:74535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.277184:0:74535:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.277515:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291748352:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.278263:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.278278:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.278301:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.278328:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.278343:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.278982:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291748864:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.279125:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00010000:00010000:0.0:1767317535.285898:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.285936:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.285956:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.285973:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317535.285994:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.286012:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.286021:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.286052:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.286061:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317535.286087:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291748480:192.168.202.133@tcp:101:ll_agl.0 00000100:00100000:1.0:1767317535.291440:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291748864:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.292613:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.292636:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.292999:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767317535.293025:0:83367:0:(file.c:424:ll_file_release()) START file dir.copy:[0x200000405:0x9:0x0](ffff8c3c485e5b88), flags 704000 00000002:00100000:1.0:1767317535.293125:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c46a3aa00 x1853164291747840/t8589937385(8589937385) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.293140:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.293147:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291749120/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.293176:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291749120:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.293429:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.298976:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291749120:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.299025:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c46a3aa00 x1853164291747840/t8589937385(8589937385) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.299124:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.299138:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir.copy, flags=0 00000080:00200000:1.0:1767317535.299147:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317535.299153:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=dir.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00010000:00010000:1.0:1767317535.299203:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.299269:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.299277:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.299301:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d571 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.299326:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.299361:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.299368:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.299370:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d578 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d6b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317535.299391:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317535.299398:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2a00 x1853164291749504/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317535.299419:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291749504:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.299537:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.299613:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317535.299630:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291749248:192.168.202.133@tcp:103:rm.0 00000100:00100000:0.0:1767317535.302923:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291749248:192.168.202.133@tcp:103:rm.0 00000100:00100000:2.0:1767317535.306092:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.306260:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379220096 00000100:00100000:3.0:1767317535.306274:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379220096 00000100:00100000:3.0:1767317535.306344:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9516 00000100:00100000:3.0:1767317535.306355:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379220096:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.306378:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.306499:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.306507:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379220096:12345-192.168.202.133@tcp:104: Request processed in 153us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.306516:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9516 00010000:00010000:1.0:1767317535.306847:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317535.306865:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.306915:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.306921:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.306931:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.306939:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.307097:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.307105:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.307131:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.307139:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d55c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d1e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.307159:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.307161:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.307163:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.307407:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291749632:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.315976:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291749632:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317535.318833:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.319159:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317535.319186:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379220992 00000100:00100000:3.0:1767317535.319208:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379220992 00000100:00100000:3.0:1767317535.319285:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9517 00000100:00100000:3.0:1767317535.319299:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379220992:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.319321:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.319427:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.319435:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379220992:12345-192.168.202.133@tcp:104: Request processed in 140us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.319444:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9517 00010000:00010000:1.0:1767317535.319990:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317535.320001:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320030:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.320037:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320047:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320057:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320188:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 2/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320205:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.320240:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 1/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320248:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d57f lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.320268:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.320270:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.320272:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.320339:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291749760:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317535.325728:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317535.325836:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379221248 00000100:00100000:2.0:1767317535.325849:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379221248 00000100:00100000:2.0:1767317535.325962:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9518 00000100:00100000:2.0:1767317535.325975:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379221248:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317535.325997:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.326091:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317535.326099:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379221248:12345-192.168.202.133@tcp:104: Request processed in 128us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317535.326107:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9518 00010000:00010000:1.0:1767317535.326334:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317535.326344:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326353:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.326358:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326388:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326399:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326530:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326538:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.326559:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326567:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72d87 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.326585:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.326587:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.326589:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.326769:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291749760:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.326796:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317535.326808:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291749888:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.336796:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291749888:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317535.342984:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291749504:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317535.343045:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x9:0x0](ffff8c3c485e5b88) 00000080:00200000:1.0:1767317535.343147:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.343184:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:1.0:1767317535.343190:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), intent=getattr 00010000:00010000:1.0:1767317535.343225:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767317535.343242:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d594 from it ffffa7f7c1c1fbe8 00010000:00010000:1.0:1767317535.343270:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.343279:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317535.343311:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317535.343317:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00010000:00010000:1.0:1767317535.343366:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317535.343388:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x6:0x0]: losing layout lock 00010000:00010000:1.0:1767317535.343443:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.343450:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.343453:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90400/0x73c3d5cb1442d594 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72da3 expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317535.343481:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317535.343491:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1500 x1853164291750144/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317535.343517:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750144:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.343624:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.347573:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750144:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317535.347652:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x6:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317535.347667:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317535.347671:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317535.347709:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767317535.347722:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00020000:00200000:1.0:1767317535.347724:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x0 00000080:00200000:1.0:1767317535.347748:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317535.347758:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x6:0x0](ffff8c3c597dc2c8) 00000080:00200000:1.0:1767317535.348146:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.348172:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=dir, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:1.0:1767317535.348178:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=dir, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), intent=getattr 00010000:00010000:1.0:1767317535.348220:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317535.348240:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d59b from it ffffa7f7c1c1f910 00010000:00010000:1.0:1767317535.348245:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348255:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.348297:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file dir:[0x200000405:0x8:0x0](ffff8c3c4857db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.348305:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88),name=dir 00000002:00010000:1.0:1767317535.348333:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.348346:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348358:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.348371:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.348377:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348399:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348409:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348417:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.348427:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.348434:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348442:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348450:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348457:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.348466:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.348474:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8:0x0](ffff8c3c4857db88) 00000080:00010000:1.0:1767317535.348478:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff8c3c4857db88) for lock 0x73c3d5cb1442d59b 00000080:00010000:1.0:1767317535.348482:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d59b from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317535.348485:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348502:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.348515:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.348520:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348527:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348535:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348542:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.348548:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.348552:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348559:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348565:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.348573:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.348618:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.348624:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir, flags=258 00000080:00200000:1.0:1767317535.348630:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.348640:0:83367:0:(file.c:1001:ll_file_open()) START file dir:[0x200000405:0x8:0x0](ffff8c3c4857db88), flags 704400 00000002:00010000:1.0:1767317535.348656:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000405:0x8:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317535.348734:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.348743:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.348758:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.348771:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291750400/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.348782:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.348811:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750400:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.350763:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.355596:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750400:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.355629:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355646:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355654:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355779:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355789:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355796:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.355801:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355809:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355817:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 5/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355825:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317535.355833:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.355840:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317535.355971:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1f80 x1853164291750400/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.355987:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291750400/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.356008:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.356052:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8:0x0], updating i_size 4096 00000002:00100000:1.0:1767317535.356074:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291750400/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.356281:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file dir:[0x200000405:0x8:0x0](ffff8c3c4857db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.356291:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88),name=dir 00000002:00010000:1.0:1767317535.356322:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.356341:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356355:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.356367:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.356373:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356380:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356389:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356398:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.356416:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.356425:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356433:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356455:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356462:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.356475:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.356481:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8:0x0](ffff8c3c4857db88) 00000080:00010000:1.0:1767317535.356486:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff8c3c4857db88) for lock 0x73c3d5cb1442d59b 00000080:00010000:1.0:1767317535.356491:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d59b from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.356494:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356502:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.356516:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.356522:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356530:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356537:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356545:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.356564:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.356570:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356578:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356586:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356591:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.356625:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317535.356639:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.356667:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.356674:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.356788:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.359497:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750528:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.359641:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.367618:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750528:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.368798:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.368842:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.369063:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.369083:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.369098:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.370071:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750656:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.370273:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.377308:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750656:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.378044:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.378064:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.378141:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767317535.378165:0:83367:0:(file.c:424:ll_file_release()) START file dir:[0x200000405:0x8:0x0](ffff8c3c4857db88), flags 704000 00000002:00100000:0.0:1767317535.378267:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291750400/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.378281:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.378286:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ce00 x1853164291750912/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.378332:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750912:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.378444:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.382791:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291750912:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.382839:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291750400/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.382967:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.382981:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir, flags=0 00000080:00200000:0.0:1767317535.382989:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.382995:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=dir, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00010000:00010000:0.0:1767317535.383035:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.383154:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.383212:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.383221:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 1/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.383227:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.383230:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90000/0x73c3d5cb1442d59b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72dbf expref: -99 pid: 83374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.383247:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d555 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d10 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.383289:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.383296:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9ce00 x1853164291751168/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.383323:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751168:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.383437:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:2.0:1767317535.386570:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.386671:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379222656 00000100:00100000:3.0:1767317535.386688:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379222656 00000100:00100000:3.0:1767317535.386745:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9519 00000100:00100000:3.0:1767317535.386755:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379222656:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.386777:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.386898:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.386906:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:19567:x1853164379222656:12345-192.168.202.133@tcp:104: Request processed in 152us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.386931:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9519 00010000:00010000:0.0:1767317535.387432:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317535.387442:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387453:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.387460:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387469:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387478:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387591:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387598:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.387621:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 1/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387629:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d5a9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e05 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.387657:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.387659:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.387661:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.387692:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291751296:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.390426:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291751296:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317535.392396:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.392617:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379222912 00000100:00100000:3.0:1767317535.392630:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379222912 00000100:00100000:3.0:1767317535.392699:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9520 00000100:00100000:3.0:1767317535.392709:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379222912:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.392730:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.392938:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.392947:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379222912:12345-192.168.202.133@tcp:104: Request processed in 238us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.392955:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9520 00010000:00010000:0.0:1767317535.395419:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317535.395435:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395450:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.395456:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395466:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395476:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395630:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395637:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317535.395739:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291751424:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317535.395981:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.395991:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d5be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72e13 expref: -99 pid: 74535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.396019:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.396021:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.396023:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317535.403625:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291751424:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.413982:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751168:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.414043:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8:0x0](ffff8c3c4857db88) 00000080:00200000:0.0:1767317535.414137:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.414158:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:0.0:1767317535.414164:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8), intent=getattr 00010000:00010000:0.0:1767317535.414215:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317535.414235:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5a2 from it ffffa7f7c1c1fbe8 00010000:00010000:0.0:1767317535.414241:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.414251:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.414292:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.414299:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00010000:00010000:0.0:1767317535.414355:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.414376:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1767317535.414429:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.414460:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.414463:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91400/0x73c3d5cb1442d5a2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72ddb expref: -99 pid: 83374 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767317535.414492:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.414503:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291751680/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.414528:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751680:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.414639:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.419812:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751680:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.419963:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317535.419980:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317535.419984:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317535.419992:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00020000:00200000:0.0:1767317535.420003:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[4] flags 0x0 00000080:00200000:0.0:1767317535.420026:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317535.420037:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x7:0x0](ffff8c3c4857ec08) 00000080:00200008:0.0:1767317535.420142:0:83367:0:(file.c:424:ll_file_release()) START file d46.sanity-flr:[0x200000405:0x4:0x0](ffff8c3c617342c8), flags 704000 00010000:00010000:0.0:1767317535.420203:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.420249:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.420272:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.420282:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.420315:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.420323:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.420330:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.420334:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d547 00000080:00010000:0.0:1767317535.420343:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d547 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317535.420348:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.420357:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.420375:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.420387:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=0 00000080:00200000:0.0:1767317535.420394:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.420401:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.420407:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.420415:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.420421:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.420425:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.420428:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d547 00000080:00010000:0.0:1767317535.420432:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d547 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317535.420436:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.420449:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.420459:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.420466:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317535.420490:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.420517:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.420572:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1180 x1853164291747072/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.420584:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.420590:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d880 x1853164291751936/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.420616:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751936:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.420727:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.427566:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291751936:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.427612:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1180 x1853164291747072/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317535.427673:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427738:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427763:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427772:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427777:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767317535.427781:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d56a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d3a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427791:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d54e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72d02 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.427805:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72ce6 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.427826:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.427832:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9d880 x1853164291752192/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.427866:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752192:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.428058:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.443720:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752192:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.443778:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x4:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317535.443972:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.444002:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.444078:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.444104:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.444115:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.444138:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752320:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.444259:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.447619:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752320:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.447652:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447666:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447679:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447703:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447717:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447726:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447734:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.447773:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f480 x1853164291752320/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.447790:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.447805:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317535.447813:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.447850:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.447867:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d5cc 00000080:00010000:0.0:1767317535.448200:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.448204:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5cc from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317535.448209:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.448220:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.448250:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.448275:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317535.448281:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317535.448310:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d4.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.448364:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.448373:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.448384:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.448418:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752448:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.448536:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.452341:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752448:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.452376:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452404:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452413:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452426:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452437:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452451:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452458:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452465:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.452478:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f480 x1853164291752448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.452511:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.452523:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/37 (0 0) 00000080:00200000:0.0:1767317535.452531:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.452580:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8) 00000002:00010000:0.0:1767317535.452619:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.452679:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.452687:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.452697:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.452721:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752576:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.452840:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.456271:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752576:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.456304:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 4/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456319:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456333:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456345:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456379:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456387:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456395:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.456408:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291752576/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.456424:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456440:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/5 (0 0) 00010000:00010000:0.0:1767317535.456449:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.456456:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.456492:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.456555:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.456563:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.456573:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.456605:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752704:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.456721:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.459511:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752704:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.459544:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459559:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459572:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459583:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459597:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459607:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459614:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.459626:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291752704/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.459641:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459674:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/5 (0 0) 00010000:00010000:0.0:1767317535.459695:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459704:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.459743:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x25:0x0], updating i_size 8192 00000080:00010000:0.0:1767317535.459756:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d5d3 00000080:00010000:0.0:1767317535.459771:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.459775:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5d3 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317535.459778:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.459788:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317535.459821:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.459829:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8),name=d4.sanity-flr 00000002:00010000:0.0:1767317535.460037:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460051:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460063:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.460073:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460089:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460097:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460105:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460112:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.460122:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460127:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460135:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460142:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460148:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.460156:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317535.460161:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.460165:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d5d3 00000080:00010000:0.0:1767317535.460352:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5d3 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317535.460357:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460371:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.460385:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460391:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460399:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460407:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460415:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.460422:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460427:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460433:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460440:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460447:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.460530:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.460539:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.460547:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460555:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.460561:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.460566:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.460568:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d5cc 00000080:00010000:0.0:1767317535.460571:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5cc from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317535.460574:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.460582:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.460589:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.460596:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=266 00000080:00200000:0.0:1767317535.460602:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317535.460613:0:83367:0:(file.c:1001:ll_file_open()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), flags 704400 00000002:00010000:0.0:1767317535.460630:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317535.460705:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.460713:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.460735:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.460748:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291752960/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.460758:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.460783:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752960:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.463544:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.471672:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291752960:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.471718:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471734:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471741:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471749:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471758:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471764:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.471770:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471777:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471807:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471814:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.471822:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.471829:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.471862:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c50e9f480 x1853164291752960/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.471941:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f480 x1853164291752960/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.471964:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.472008:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x25:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.472030:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c50e9f480 x1853164291752960/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.472117:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.472126:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8),name=d4.sanity-flr 00000002:00010000:0.0:1767317535.472152:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.472170:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472183:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.472204:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.472219:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472227:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472236:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472244:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.472263:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.472272:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472280:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472287:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472294:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.472304:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317535.472310:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) 00000080:00010000:0.0:1767317535.472315:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d5d3 00000080:00010000:0.0:1767317535.472319:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5d3 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.472323:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472338:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.472352:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.472357:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472365:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472373:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472380:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.472389:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.472393:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472400:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472406:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472413:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.472459:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317535.472472:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.472497:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.472503:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.472510:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.473230:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753088:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.473374:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.481787:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753088:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.482555:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.482576:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.482608:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.482627:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.482642:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.483335:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753216:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.483464:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.491330:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753216:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.492234:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.492253:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.492349:0:83367:0:(file.c:424:ll_file_release()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), flags 704000 00000002:00100000:1.0:1767317535.492439:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9f480 x1853164291752960/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.492467:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.492474:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291753472/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.492501:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753472:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.492623:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.497678:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753472:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.497821:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9f480 x1853164291752960/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.498104:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.498130:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.498152:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.498169:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.498178:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.498186:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.498200:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d5cc 00000080:00010000:1.0:1767317535.498209:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5cc from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317535.498214:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.498224:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.498266:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.498275:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=266 00000080:00200000:1.0:1767317535.498283:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.498294:0:83367:0:(file.c:1001:ll_file_open()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), flags 704400 00000002:00010000:1.0:1767317535.498313:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317535.498380:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.498388:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.498399:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.498406:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291753728/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.498416:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.498439:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753728:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.499348:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.502501:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753728:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.502546:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 4/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502558:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 4/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502572:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502602:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.502620:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1180 x1853164291753728/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.502635:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291753728/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.502653:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502665:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935618/37 (0 0) 00000080:00200000:1.0:1767317535.502673:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.502723:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x25:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.502732:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d5ef 00000080:00010000:1.0:1767317535.502742:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5ef from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317535.502747:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502757:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.502786:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291753728/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.502922:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.502932:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8),name=d4.sanity-flr 00000002:00010000:1.0:1767317535.502958:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.502975:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.502988:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.502999:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.503005:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503013:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503021:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503028:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.503038:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.503046:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503054:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503062:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503069:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.503088:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.503095:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) 00000080:00010000:1.0:1767317535.503099:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff8c3c617342c8) for lock 0x73c3d5cb1442d5d3 00000080:00010000:1.0:1767317535.503104:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5d3 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.503107:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503114:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.503126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.503132:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503140:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503148:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503155:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.503164:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.503169:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503176:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503201:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503209:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.503253:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317535.503267:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.503293:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.503300:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503308:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.503321:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.503325:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503332:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.503344:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.503349:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503357:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.503380:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.503383:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.503389:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.503434:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767317535.503463:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.503481:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=td, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:1.0:1767317535.503486:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=td, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8), intent=getattr 00000002:00010000:1.0:1767317535.503501:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: td,[0x0:0x0:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.503549:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.503557:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.503567:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.503593:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753856:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.503702:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.509642:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753856:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.509677:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509794:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509824:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509838:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509944:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509961:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509969:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.509978:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.509992:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1f80 x1853164291753856/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/672 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.510010:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.510023:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/38 (0 0) 00000080:00200000:1.0:1767317535.510032:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.510091:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88) 00000002:00010000:1.0:1767317535.510128:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.510276:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.510293:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.510302:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.510328:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753984:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.510454:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.514082:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291753984:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.514113:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 4/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514126:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 4/1,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514140:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514154:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514249:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514260:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514267:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.514302:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291753984/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.514320:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514335:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935616/6 (0 0) 00010000:00010000:1.0:1767317535.514342:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.514351:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.514385:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.514448:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.514457:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.514466:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.514489:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754112:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.514626:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.518520:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754112:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.518556:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518592:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518607:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518620:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518642:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518650:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.518663:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291754112/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.518679:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518804:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677440/6 (0 0) 00010000:00010000:1.0:1767317535.518814:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.518823:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.519045:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x26:0x0], updating i_size 8192 00000080:00010000:1.0:1767317535.519060:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d5f6 00000080:00010000:1.0:1767317535.519076:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) 00000080:00010000:1.0:1767317535.519080:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5f6 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317535.519085:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.519094:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.519131:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file td:[0x200000402:0x26:0x0](ffff8c3c485e5b88), request_mask 2047, flags 0, foreign 0 00000002:00010000:1.0:1767317535.519247:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.519262:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.519274:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.519291:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.519295:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.519302:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.519314:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.519321:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.519334:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317535.519348:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317535.519351:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.519358:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.520065:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88),name=td 00000002:00010000:1.0:1767317535.520094:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x26:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.520104:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520115:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.520126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.520132:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520140:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520150:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520158:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.520189:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.520205:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520212:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520219:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520225:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.520236:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.520244:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) 00000080:00010000:1.0:1767317535.520248:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d5f6 00000080:00010000:1.0:1767317535.520253:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5f6 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317535.520255:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520262:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.520275:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.520281:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520288:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520302:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520309:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.520318:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.520324:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520331:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520337:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.520343:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.520406:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.520416:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=td, flags=258 00000080:00200000:1.0:1767317535.520429:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.520440:0:83367:0:(file.c:1001:ll_file_open()) START file td:[0x200000402:0x26:0x0](ffff8c3c485e5b88), flags 704400 00000002:00010000:1.0:1767317535.520462:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x26:0x0]) in obj [0x200000402:0x26:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317535.520523:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.520531:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.520559:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.520572:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291754368/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.520582:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.520606:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754368:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.520923:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000002:00010000:0.0:1767317535.523908:0:83376:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.523940:0:83376:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.523959:0:83376:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317535.523979:0:83376:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317535.523984:0:83376:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.523992:0:83376:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.524013:0:83376:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.524030:0:83376:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.524039:0:83376:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317535.524053:0:83376:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317535.524056:0:83376:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.524062:0:83376:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.524151:0:83376:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83376 initiator: MDT0 00010000:00010000:0.0:1767317535.524159:0:83376:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83376 initiator: MDT0 00000100:00100000:1.0:1767317535.524696:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291754496:192.168.202.133@tcp:63:ll_sa.0 00010000:00010000:1.0:1767317535.529396:0:2517:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529436:0:2517:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529444:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529457:0:2517:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529469:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529481:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529489:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.529519:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.529538:0:2517:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9f800 x1853164291754496/t0(0) o63->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:24/4 lens 672/1072 e 0 to 0 dl 1767317552 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:1.0:1767317535.529552:0:2517:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317535.529568:0:2517:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d612 from it ffff8c3c6115d588 00010000:00010000:1.0:1767317535.529572:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.529582:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767317535.529622:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291754496:192.168.202.133@tcp:63:ll_sa.0 00010000:00010000:1.0:1767317535.529673:0:77461:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317535.529722:0:77461:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x7:0x0](ffff8c3c485e4b08) 00000080:00200000:1.0:1767317535.529821:0:77461:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x7:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1767317535.529827:0:77461:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x7:0x0](ffff8c3c485e4b08) for lock 0x73c3d5cb1442d612 00000080:00010000:1.0:1767317535.529854:0:77461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d612 from it ffff8c3c6115d588 00010000:00010000:1.0:1767317535.529858:0:77461:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.529865:0:77461:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.530731:0:83377:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317535.530749:0:83377:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x7:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317535.530752:0:83377:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317535.530756:0:83377:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x240000401:0x7:0x0] 00000008:00010000:0.0:1767317535.530781:0:83377:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1767317535.530786:0:83377:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287c30, osc lock ffff8c3c50c8f8f0, flags 0x400000400041012 00010000:00010000:0.0:1767317535.530906:0:83377:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.530919:0:83377:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400041010 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317535.530933:0:83377:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9df80 x1853164291754624/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00010000:0.0:1767317535.530979:0:83377:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_release():245 00000020:00010000:0.0:1767317535.530983:0:83377:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317535.530986:0:83377:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287c30 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317535.530991:0:83377:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317535.530994:0:83377:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287c30 (ffff8c3c547fd488/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317535.531008:0:83377:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x7:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1767317535.531916:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291754624:192.168.202.133@tcp:101:ll_agl.0 00000100:00100000:1.0:1767317535.535146:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754368:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.535179:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535206:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535214:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/1,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535221:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535230:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535238:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.535243:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535251:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535259:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 5/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535268:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317535.535276:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.535308:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d60b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x26:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317535.535331:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1f80 x1853164291754368/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.535347:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291754368/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.535366:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000402:0x26:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.535406:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x26:0x0], updating i_size 4096 00000002:00100000:1.0:1767317535.535429:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1f80 x1853164291754368/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.535514:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file td:[0x200000402:0x26:0x0](ffff8c3c485e5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.535523:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88),name=td 00000002:00010000:1.0:1767317535.535551:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x26:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.535568:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535580:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.535593:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.535599:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535606:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535626:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535634:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.535652:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.535659:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535667:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535674:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535778:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.535791:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.535797:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) 00000080:00010000:1.0:1767317535.535801:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x26:0x0](ffff8c3c485e5b88) for lock 0x73c3d5cb1442d5f6 00000080:00010000:1.0:1767317535.535806:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5f6 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.535809:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.535816:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.535840:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.535846:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536062:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536072:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536078:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.536088:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.536094:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536100:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536106:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536112:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.536147:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317535.536159:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.536188:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.536222:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.536229:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.537230:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754752:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.537368:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00010000:00010000:1.0:1767317535.546128:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546165:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546184:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546211:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317535.546231:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546249:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546284:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546293:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317535.546302:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317535.546327:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291754624:192.168.202.133@tcp:101:ll_agl.0 00000100:00100000:0.0:1767317535.547066:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754752:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.548081:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.548102:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.548134:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.548152:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.548168:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.549107:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754880:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.549343:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.556478:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291754880:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.557424:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.557468:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.557550:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767317535.557573:0:83367:0:(file.c:424:ll_file_release()) START file td:[0x200000402:0x26:0x0](ffff8c3c485e5b88), flags 704000 00000002:00100000:0.0:1767317535.557665:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1f80 x1853164291754368/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.557789:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.557799:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9df80 x1853164291755136/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.557828:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755136:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.558069:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.563012:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755136:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.563064:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1f80 x1853164291754368/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.563151:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.563168:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=td, flags=0 00000080:00200000:0.0:1767317535.563178:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.563185:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=td, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8) 00010000:00010000:0.0:1767317535.563243:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.563362:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.563432:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.563440:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 1/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.563446:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.563450:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d5f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f78 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.563466:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d5da lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f2b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.563487:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.563494:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9df80 x1853164291755392/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 488/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.563520:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755392:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.563645:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:2.0:1767317535.571603:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317535.572466:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379225088 00000100:00100000:3.0:1767317535.572485:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379225088 00000100:00100000:3.0:1767317535.572594:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9521 00000100:00100000:3.0:1767317535.572607:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379225088:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317535.572637:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317535.572760:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317535.572767:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15479:x1853164379225088:12345-192.168.202.133@tcp:104: Request processed in 164us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317535.572776:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9521 00010000:00010000:0.0:1767317535.572828:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317535.572837:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.572847:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.572863:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.572907:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.572936:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.573061:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.573069:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.573092:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 1/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.573099:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d5fd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f86 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.573119:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.573121:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.573123:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317535.573507:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291755520:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317535.580205:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:0.0:1767317535.580444:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291755520:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317535.581506:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379225344 00000100:00100000:2.0:1767317535.581523:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379225344 00000100:00100000:2.0:1767317535.581655:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9522 00000100:00100000:2.0:1767317535.581667:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379225344:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317535.581717:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.581827:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317535.581834:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379225344:12345-192.168.202.133@tcp:104: Request processed in 170us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317535.581843:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9522 00010000:00010000:0.0:1767317535.581960:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317535.581969:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.581980:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.581987:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.581997:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.582019:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.582163:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.582186:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.582255:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.582264:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d604 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a72f94 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.582285:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.582287:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317535.582289:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.582303:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317535.582319:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291755648:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317535.585050:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317535.595818:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291755648:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.602105:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755392:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.602168:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x26:0x0](ffff8c3c485e5b88) 00000080:00200000:0.0:1767317535.602293:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.602322:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8), flags=0 00000080:00200000:0.0:1767317535.602329:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8), intent=getattr 00010000:00010000:0.0:1767317535.602357:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767317535.602396:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d612 from it ffffa7f7c1c1fbe8 00010000:00010000:0.0:1767317535.602402:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.602411:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.602453:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.602460:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x25:0x0](ffff8c3c617342c8) 00010000:00010000:0.0:1767317535.602504:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.602572:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.602584:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1767317535.602625:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.602633:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.602639:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.602642:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d612 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72fbe expref: -99 pid: 83376 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.602658:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d5e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.602690:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.602699:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f800 x1853164291755904/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.602725:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755904:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.602843:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.607846:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291755904:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.607951:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x7:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1767317535.607967:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x7:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317535.607971:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317535.607979:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767317535.607993:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1767317535.608021:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317535.608030:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x7:0x0](ffff8c3c485e4b08) 00000080:00200008:0.0:1767317535.608151:0:83367:0:(file.c:424:ll_file_release()) START file d4.sanity-flr:[0x200000402:0x25:0x0](ffff8c3c617342c8), flags 704000 00010000:00010000:0.0:1767317535.608214:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.608813:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.608839:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.609134:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.609148:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.609158:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.609338:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.609343:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d5cc 00000080:00010000:0.0:1767317535.609353:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5cc from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317535.609358:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.609367:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.609387:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.609400:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=0 00000080:00200000:0.0:1767317535.609408:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.609418:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.609425:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.609432:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.609439:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.609442:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.609445:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d5cc 00000080:00010000:0.0:1767317535.609448:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d5cc from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317535.609451:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.609457:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.609465:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.609478:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317535.609503:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.609534:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.609597:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1180 x1853164291753728/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.609611:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.609618:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291756160/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.609647:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756160:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.609861:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.614677:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756160:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.614735:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1180 x1853164291753728/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317535.614806:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614907:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 1/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614915:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614923:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614942:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767317535.614947:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d5ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614960:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d5d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f1d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.614975:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d5cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a72f01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.614997:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.615005:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9f480 x1853164291756416/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.615032:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756416:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.615134:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.631956:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756416:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.632018:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x25:0x0](ffff8c3c617342c8) 00000080:00200000:0.0:1767317535.632132:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.632161:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.632267:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.632279:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.632292:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.632343:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756544:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.632459:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.638985:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756544:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.639022:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639036:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639050:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639062:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639076:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639085:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639094:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.639107:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291756544/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.639124:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639162:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317535.639183:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.639228:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.639236:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d620 00000080:00010000:0.0:1767317535.639494:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.639498:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d620 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317535.639503:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.639512:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.639545:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.639570:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317535.639575:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317535.639604:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.639656:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.639664:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.639676:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.639703:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756672:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.639823:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.643743:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756672:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.643799:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643824:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643833:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643847:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643913:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643928:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643937:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643945:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.643958:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9ea00 x1853164291756672/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.643972:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.643983:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/7 (0 0) 00000002:00010000:0.0:1767317535.644009:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.644074:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.644081:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.644091:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.644116:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756800:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.644234:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.648724:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291756800:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.648761:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 4/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648776:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648790:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648803:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648817:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648824:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648868:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.648929:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efc700 x1853164291756800/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.648943:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.648960:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/7 (0 0) 00000080:00200000:0.0:1767317535.648986:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.649030:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00200000:0.0:1767317535.649039:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x7:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.649048:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for remote lock 0x73c3d5cb1442d62e 00000080:00010000:0.0:1767317535.649054:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d627 00000080:00010000:0.0:1767317535.649068:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.649073:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d627 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317535.649078:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649088:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317535.649105:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d62e from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317535.649109:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649116:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317535.649161:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.649181:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767317535.649221:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.649232:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649654:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.649664:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.649670:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.649674:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d62e 00000080:00010000:0.0:1767317535.649680:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d62e from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317535.649684:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649692:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.649756:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.649767:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.649777:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649786:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.649792:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.649804:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.649806:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d620 00000080:00010000:0.0:1767317535.649811:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d620 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317535.649814:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.649821:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.649830:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.649837:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50a.sanity-flr, flags=266 00000080:00200000:0.0:1767317535.649844:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317535.649953:0:83367:0:(file.c:1001:ll_file_open()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), flags 704400 00000002:00010000:0.0:1767317535.649974:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317535.650046:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.650053:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.650067:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.650077:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efc700 x1853164291757056/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.650088:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.650114:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757056:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.650546:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.655548:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757056:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.655600:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655616:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655624:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655632:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655641:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655647:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.655652:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655660:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655668:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655676:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.655786:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.655794:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.655825:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efc700 x1853164291757056/t4294976329(4294976329) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.656026:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efc700 x1853164291757056/t4294976329(4294976329) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.656044:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.656070:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x7:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.656094:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efc700 x1853164291757056/t4294976329(4294976329) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.656337:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.656348:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767317535.656377:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.656395:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.656409:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.656417:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.656424:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.656429:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d62e 00000080:00010000:0.0:1767317535.656435:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d62e from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.656439:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.656448:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.656492:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317535.656520:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x240000404:0x7:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.656527:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.656535:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.657644:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757184:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.658060:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.665147:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757184:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.665930:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.665949:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317535.666029:0:83367:0:(file.c:424:ll_file_release()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), flags 704000 00000002:00100000:0.0:1767317535.666124:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efc700 x1853164291757056/t4294976329(4294976329) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.666139:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.666144:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd880 x1853164291757440/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.666187:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757440:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.666312:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.669466:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757440:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.669513:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efc700 x1853164291757056/t4294976329(4294976329) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.669636:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.669662:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.669684:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.669699:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.669708:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.669715:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.669719:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d620 00000080:00010000:0.0:1767317535.669727:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d620 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317535.669731:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.669740:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.669759:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.669768:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50a.sanity-flr, flags=266 00000080:00200000:0.0:1767317535.669778:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317535.669788:0:83367:0:(file.c:1001:ll_file_open()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), flags 704400 00000002:00010000:0.0:1767317535.669806:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317535.669940:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.669949:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.669974:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.669982:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd880 x1853164291757696/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.669991:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.670017:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757696:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.670843:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.675739:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757696:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.675797:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 4/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.675810:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 4/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.675825:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.675837:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.675864:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c42efd880 x1853164291757696/t4294976331(4294976331) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.675950:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd880 x1853164291757696/t4294976331(4294976331) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.675963:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.675992:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/7 (0 0) 00000080:00200000:0.0:1767317535.676000:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.676025:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x7:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.676032:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d63c 00000080:00010000:0.0:1767317535.676042:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d63c from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317535.676046:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.676055:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.676090:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd880 x1853164291757696/t4294976331(4294976331) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.676177:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.676185:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767317535.676226:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.676236:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.676249:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.676255:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.676260:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.676264:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d62e 00000080:00010000:0.0:1767317535.676268:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d62e from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.676277:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.676284:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.676326:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317535.676356:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317535.676382:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.676399:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50a.sanity-flr, dir=[0x240000404:0x7:0x0](ffff8c3c485142c8), flags=0 00000080:00200000:0.0:1767317535.676404:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50a.sanity-flr, dir=[0x240000404:0x7:0x0](ffff8c3c485142c8), intent=getattr 00000002:00010000:0.0:1767317535.676422:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000404:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.676475:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.676483:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.676493:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.676517:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757824:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.676631:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.682549:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291757824:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.682585:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682614:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682646:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682661:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682674:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682689:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682698:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.682706:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.682720:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efc700 x1853164291757824/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1160 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.682733:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 576 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317535.682747:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.682760:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/8 (0 0) 00000080:00200000:0.0:1767317535.682769:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000404:0x7:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.682818:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x8:0x0](ffff8c3c48515b88) 00000080:00200000:0.0:1767317535.682972:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x8:0x0], updating i_size 3700000 00000080:00200000:0.0:1767317535.683002:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x8:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:0.0:1767317535.683008:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x8:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d643 00000080:00010000:0.0:1767317535.683021:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x8:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317535.683025:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d643 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317535.683029:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.683039:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.683079:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.683088:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50a.sanity-flr, dir=[0x240000404:0x7:0x0](ffff8c3c485142c8) 00010000:00010000:0.0:1767317535.683127:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.683242:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317535.683254:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x8:0x0]: losing layout lock 00010000:00010000:0.0:1767317535.683292:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.683300:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 1/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.683305:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.683308:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d643 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a730ac expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317535.683340:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d62e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7306d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.683360:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.683368:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efc700 x1853164291758080/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.683395:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758080:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317535.683515:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.688693:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758080:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.688774:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317535.688789:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317535.688792:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317535.688801:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767317535.688813:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317535.688943:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317535.688953:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x8:0x0](ffff8c3c48515b88) 00000080:00200008:0.0:1767317535.689085:0:83367:0:(file.c:424:ll_file_release()) START file d50a.sanity-flr:[0x240000404:0x7:0x0](ffff8c3c485142c8), flags 704000 00010000:00010000:0.0:1767317535.689118:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.689307:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.689333:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.689345:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.689356:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.689382:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.689389:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.689393:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d620 00000080:00010000:0.0:1767317535.689401:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d620 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317535.689406:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.689414:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.689433:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.689450:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:0.0:1767317535.689455:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317535.689471:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.689528:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.689536:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.689547:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.689575:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758208:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.689695:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178780 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.695118:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758208:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.695153:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695456:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695464:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695476:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695488:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695503:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695511:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.695518:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.695532:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efe680 x1853164291758208/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.696002:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696119:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696148:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696156:0:83367:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696163:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696273:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.696305:0:83367:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:0.0:1767317535.696328:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.696393:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.696401:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.696412:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.696441:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758336:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.697162:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00010000:00010000:1.0:1767317535.697268:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317535.697278:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697289:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.697296:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697305:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697316:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697343:0:60279:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697406:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697412:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.697451:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 1/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697458:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d64a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a730e4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.697477:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.697479:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.697481:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317535.697491:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317535.697509:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291758464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.704666:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758336:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.704717:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704760:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704776:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704790:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704805:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704814:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.704822:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.704836:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42effb80 x1853164291758336/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.705323:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705347:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/7 (0 0) 00000080:00200000:0.0:1767317535.705372:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.705401:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x7:0x0], updating i_size 4096 00000080:00200000:0.0:1767317535.705405:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x240000404:0x7:0x0](ffff8c3c485142c8): rc = 0 00000080:00010000:0.0:1767317535.705413:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for remote lock 0x73c3d5cb1442d651 00000080:00010000:0.0:1767317535.705429:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d627 00000080:00010000:0.0:1767317535.705440:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.705445:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d627 from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317535.705449:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705460:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317535.705478:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d651 from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317535.705481:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705489:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.705512:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.705534:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.705544:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705555:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.705561:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.705565:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.705569:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d620 00000080:00010000:0.0:1767317535.705573:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d620 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317535.705575:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705587:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.705596:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317535.705604:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317535.705627:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705754:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.705763:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317535.705792:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d627 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7305f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.705832:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317535.705857:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291758592:192.168.202.133@tcp:103:rm.0 00010000:00010000:0.0:1767317535.706327:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.706349:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.706390:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efd880 x1853164291757696/t4294976331(4294976331) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317535.706402:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317535.706408:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efe680 x1853164291758848/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317535.706439:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758848:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317535.706469:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.707841:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291758464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.712984:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291758848:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317535.713045:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efd880 x1853164291757696/t4294976331(4294976331) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317535.713146:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.713157:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.713164:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317535.713526:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d651 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a730f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.713545:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d63c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73089 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317535.713574:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317535.713582:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efe680 x1853164291759104/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317535.713609:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759104:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.713837:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291758592:192.168.202.133@tcp:103:rm.0 00000100:00100000:0.0:1767317535.714222:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:3.0:1767317535.720717:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317535.721213:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379226880 00000100:00100000:2.0:1767317535.721230:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379226880 00000100:00100000:2.0:1767317535.721347:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9523 00000100:00100000:2.0:1767317535.721359:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379226880:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317535.721382:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317535.721485:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317535.721493:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15854:x1853164379226880:12345-192.168.202.133@tcp:104: Request processed in 136us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317535.721501:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9523 00010000:00010000:1.0:1767317535.721561:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317535.721570:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721581:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.721586:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721596:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721622:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721712:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721719:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317535.721761:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721770:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73043 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.721797:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.721799:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317535.721801:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317535.721815:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317535.721836:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291759232:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317535.726276:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291759232:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317535.738120:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efe680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759104:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317535.738184:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x7:0x0](ffff8c3c485142c8) 00000080:00200000:0.0:1767317535.738327:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.738359:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.738446:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.738458:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.738469:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.738494:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759360:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.738632:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.748588:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759360:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.748708:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748728:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748743:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748757:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748774:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748785:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748819:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.748835:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291759360/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.748864:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.748931:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317535.748939:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.748979:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.748987:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d658 00000080:00010000:0.0:1767317535.748995:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.748999:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d658 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317535.749003:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.749012:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.749049:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.749085:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317535.749091:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317535.749126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.749183:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.749212:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.749223:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.749247:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759488:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.749373:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.758045:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759488:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.758083:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758114:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758123:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758138:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758151:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758165:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758317:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758349:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317535.758363:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291759488/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317535.758376:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758389:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/16 (0 0) 00000080:00200000:0.0:1767317535.758397:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317535.758443:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00200000:0.0:1767317535.758453:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x10:0x0], updating i_size 4096 00000080:00010000:0.0:1767317535.758461:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d65f 00000080:00010000:0.0:1767317535.758475:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.758479:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d65f from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317535.758483:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758491:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317535.758541:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.758550:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8),name=d50A.sanity-flr 00000002:00010000:0.0:1767317535.758582:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.758591:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758808:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.758817:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.758823:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.758826:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d65f 00000080:00010000:0.0:1767317535.758831:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d65f from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317535.758834:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.758842:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.759028:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317535.759039:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.759048:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.759057:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.759063:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.759068:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317535.759071:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d658 00000080:00010000:0.0:1767317535.759075:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d658 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317535.759079:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.759096:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.759106:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317535.759114:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50A.sanity-flr, flags=266 00000080:00200000:0.0:1767317535.759120:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317535.759131:0:83367:0:(file.c:1001:ll_file_open()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), flags 704400 00000002:00010000:0.0:1767317535.759149:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317535.759222:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.759231:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.759244:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.759255:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd880 x1853164291759744/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.759264:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.759289:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759744:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.759804:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.765391:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759744:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.765423:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765439:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765475:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765482:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765490:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765496:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.765502:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765508:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765516:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765523:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.765530:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.765536:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.765556:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efd880 x1853164291759744/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.765571:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd880 x1853164291759744/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.765586:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.765636:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x10:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.765667:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd880 x1853164291759744/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.765763:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.765772:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8),name=d50A.sanity-flr 00000002:00010000:0.0:1767317535.765800:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.765817:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.765844:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.765853:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.765859:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00010000:0.0:1767317535.765863:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d65f 00000080:00010000:0.0:1767317535.765869:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d65f from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.765951:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.765959:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.765999:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317535.766025:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000405:0x10:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.766031:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.766039:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.766714:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759872:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.766855:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.776792:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291759872:192.168.202.133@tcp:37:rm.0 00000080:00200000:3.0:1767317535.777080:0:8441:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317535.777134:0:8441:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317535.777167:0:8441:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317535.777205:0:8441:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317535.777209:0:8441:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317535.777216:0:8441:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767317535.786096:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.786123:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.786834:0:83367:0:(file.c:424:ll_file_release()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), flags 704000 00000002:00100000:1.0:1767317535.786979:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efd880 x1853164291759744/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.786994:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.787000:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291760128/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.787031:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760128:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.787183:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.830860:0:83367:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937403 gen 1 00000100:00100000:1.0:1767317535.831039:0:83367:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff8c3c437c1c00 x1853164291760128/t8589937404(8589937404) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/456 e 0 to 0 dl 1767317551 ref 3 fl Rpc:RQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767317535.831056:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760128:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.831093:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efd880 x1853164291759744/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RMQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.831198:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.831224:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.831246:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.831263:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.831272:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.831278:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.831282:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d658 00000080:00010000:1.0:1767317535.831291:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d658 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317535.831296:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.831305:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.831322:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.831331:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50A.sanity-flr, flags=266 00000080:00200000:1.0:1767317535.831355:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.831366:0:83367:0:(file.c:1001:ll_file_open()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), flags 704400 00000002:00010000:1.0:1767317535.831386:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317535.831453:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.831461:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.831474:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.831481:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291760384/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.831491:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.831515:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760384:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.831782:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.837836:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760384:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.837916:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.837929:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.837942:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.837954:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.837994:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1c00 x1853164291760384/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.838008:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291760384/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.838021:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.838031:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/16 (0 0) 00000080:00200000:1.0:1767317535.838039:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.838064:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x10:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.838070:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d66d 00000080:00010000:1.0:1767317535.838079:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d66d from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317535.838083:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.838093:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.838123:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291760384/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.838221:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.838229:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8),name=d50A.sanity-flr 00000002:00010000:1.0:1767317535.838256:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.838266:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.838288:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.838295:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.838300:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00010000:1.0:1767317535.838305:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d65f 00000080:00010000:1.0:1767317535.838308:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d65f from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.838312:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.838319:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.838355:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767317535.838382:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767317535.838408:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.838426:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0x10:0x0](ffff8c3c485142c8), flags=0 00000080:00200000:1.0:1767317535.838431:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0x10:0x0](ffff8c3c485142c8), intent=getattr 00000002:00010000:1.0:1767317535.838444:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x10:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.838494:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.838501:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.838510:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.838532:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760512:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.838645:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.853068:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760512:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.853104:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853143:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853150:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853160:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853169:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853183:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853203:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853210:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.853222:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2a00 x1853164291760512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/720 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.853236:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.853272:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.853283:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/17 (0 0) 00000080:00200000:1.0:1767317535.853291:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x10:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.853336:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x11:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317535.853417:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x11:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767317535.853422:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x11:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d674 00000080:00010000:1.0:1767317535.853433:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x11:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.853436:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d674 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317535.853439:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.853445:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317535.853477:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317535.853485:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0x10:0x0](ffff8c3c485142c8) 00010000:00010000:1.0:1767317535.853518:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853536:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853606:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317535.853614:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x11:0x0]: losing layout lock 00010000:00010000:1.0:1767317535.853647:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.853652:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 1/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.853656:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317535.853657:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d674 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7326c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317535.853668:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d65f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7314d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317535.855473:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317535.855498:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2a00 x1853164291760768/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317535.855541:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760768:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.855768:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.874968:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760768:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317535.875052:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317535.875070:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317535.875106:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317535.875116:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x11:0x0](ffff8c3c485e21c8) 00000080:00200008:1.0:1767317535.875230:0:83367:0:(file.c:424:ll_file_release()) START file d50A.sanity-flr:[0x200000405:0x10:0x0](ffff8c3c485142c8), flags 704000 00010000:00010000:1.0:1767317535.875285:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.875348:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.875389:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.875402:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.875412:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.875420:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.875427:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.875431:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d658 00000080:00010000:1.0:1767317535.875439:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d658 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317535.875442:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.875450:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.875468:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.875487:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:1.0:1767317535.875492:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317535.875509:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.875565:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.875573:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.875584:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.875629:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760896:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.875740:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.889451:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291760896:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.889488:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889511:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889520:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889534:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889547:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889561:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889569:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889578:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.889590:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0380 x1853164291760896/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.889604:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889632:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/16 (0 0) 00000080:00200000:1.0:1767317535.889640:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.889668:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x10:0x0], updating i_size 4096 00000080:00200000:1.0:1767317535.889672:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x10:0x0](ffff8c3c485142c8): rc = 0 00000080:00010000:1.0:1767317535.889679:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) for lock 0x73c3d5cb1442d67b 00000080:00010000:1.0:1767317535.889692:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00010000:1.0:1767317535.889697:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d67b from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317535.889700:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889709:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.889748:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.889773:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.889783:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.889794:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.889800:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.889818:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.889821:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d658 00000080:00010000:1.0:1767317535.889825:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d658 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317535.890141:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.890166:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.890176:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317535.890196:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317535.890224:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.890252:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.890264:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.890315:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291760384/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.890327:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.890333:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291761152/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.890361:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761152:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.890464:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.901731:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761152:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.901782:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291760384/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317535.901972:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.902004:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.902013:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.902018:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317535.902022:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d67b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732a4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.902037:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d66d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73249 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.902051:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73131 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317535.902074:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317535.902081:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0380 x1853164291761408/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317535.902103:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761408:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.902257:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.911344:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761408:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317535.911407:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x10:0x0](ffff8c3c485142c8) 00000080:00200000:1.0:1767317535.911502:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.911526:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.911591:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.911630:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.911640:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.911659:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761536:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.911824:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.919464:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761536:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.919493:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919504:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919515:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919524:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919534:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919540:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919546:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.919574:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291761536/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.919588:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919601:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317535.919607:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.919651:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.919656:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d682 00000080:00010000:1.0:1767317535.919660:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.919663:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d682 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317535.919666:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.919672:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.919700:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.919726:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317535.919731:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317535.919760:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.919809:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.919814:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.919822:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.919848:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761664:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.920022:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.924279:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761664:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.924315:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924344:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924353:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924367:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924380:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924393:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924401:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924409:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.924421:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291761664/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.924450:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924484:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/21 (0 0) 00000080:00200000:1.0:1767317535.924492:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.924526:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317535.924533:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x15:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.924539:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d689 00000080:00010000:1.0:1767317535.924552:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.924555:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d689 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317535.924557:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924564:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.924607:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50b.sanity-flr:[0x200000405:0x15:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.924624:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8),name=d50b.sanity-flr 00000002:00010000:1.0:1767317535.924648:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x15:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.924654:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924663:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.924668:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.924671:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.924674:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d689 00000080:00010000:1.0:1767317535.924684:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d689 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317535.924687:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924695:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.924762:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.924769:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.924775:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924781:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.924785:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.924788:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.924790:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d682 00000080:00010000:1.0:1767317535.924792:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d682 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317535.924794:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.924798:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.924803:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.924809:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50b.sanity-flr, flags=266 00000080:00200000:1.0:1767317535.924815:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.924824:0:83367:0:(file.c:1001:ll_file_open()) START file d50b.sanity-flr:[0x200000405:0x15:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317535.924844:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x15:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317535.928181:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.928211:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317535.928228:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317535.928243:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291761920/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317535.928255:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317535.928288:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761920:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317535.928640:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317535.945291:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291761920:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317535.945326:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945371:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945379:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945386:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945396:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945403:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317535.945409:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945417:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945426:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945434:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317535.945442:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317535.945449:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317535.945472:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1c00 x1853164291761920/t8589937409(8589937409) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317535.945487:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291761920/t8589937409(8589937409) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317535.945509:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317535.945540:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x15:0x0], updating i_size 4096 00000002:00100000:0.0:1767317535.945566:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291761920/t8589937409(8589937409) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317535.945673:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50b.sanity-flr:[0x200000405:0x15:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317535.945682:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8),name=d50b.sanity-flr 00000002:00010000:0.0:1767317535.945711:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x15:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317535.945728:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.945742:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.945751:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317535.945757:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) 00000080:00010000:0.0:1767317535.945762:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x15:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d689 00000080:00010000:0.0:1767317535.945768:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d689 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317535.945772:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.945781:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317535.945822:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317535.945839:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x15:0x0]) in obj [0x200000405:0x15:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317535.946235:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.946262:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317535.948564:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762048:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317535.948738:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317535.958166:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762048:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317535.959027:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317535.959050:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.959396:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:1.0:1767317535.959418:0:83367:0:(file.c:424:ll_file_release()) START file d50b.sanity-flr:[0x200000405:0x15:0x0](ffff8c3c485e21c8), flags 704000 00000002:00100000:1.0:1767317535.959496:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291761920/t8589937409(8589937409) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317535.959507:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317535.959512:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3800 x1853164291762304/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317535.959534:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762304:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317535.959650:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.963258:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762304:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317535.963313:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291761920/t8589937409(8589937409) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.963404:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.963426:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.963445:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963458:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.963464:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.963470:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.963473:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d682 00000080:00010000:1.0:1767317535.963480:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d682 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317535.963483:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963497:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.963514:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.963523:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50b.sanity-flr, flags=0 00000080:00200000:1.0:1767317535.963529:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.963533:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.963537:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963543:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.963547:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.963549:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.963551:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d682 00000080:00010000:1.0:1767317535.963553:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d682 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317535.963554:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963558:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.963562:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317535.963566:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317535.963585:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963717:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963802:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963808:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963812:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317535.963814:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d689 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732e3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.963826:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a732c7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317535.963840:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317535.963846:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3800 x1853164291762560/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317535.964009:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762560:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317535.964119:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.968349:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762560:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317535.968407:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x15:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317535.968493:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.968517:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.968578:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.968603:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.968624:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.968645:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762688:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.968786:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.971866:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762688:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.972030:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972044:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972058:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972071:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972084:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972093:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972101:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.972137:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291762688/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.972154:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972177:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317535.972194:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.972231:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317535.972248:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d697 00000080:00010000:1.0:1767317535.972277:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.972282:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d697 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317535.972285:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.972294:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.972324:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.972348:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317535.972352:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317535.972377:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.972419:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.972423:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.972430:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.972456:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762816:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.972548:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.975073:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762816:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.975103:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975129:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975137:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975149:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975159:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975184:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975204:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975212:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.975224:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291762816/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.975366:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.975378:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/25 (0 0) 00000080:00200000:1.0:1767317535.975385:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317535.975439:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000002:00010000:1.0:1767317535.975471:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.975529:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.975535:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.975542:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.975560:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762944:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.975646:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.978071:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291762944:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.978101:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978114:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978126:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978138:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978170:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978179:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978198:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.978211:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0000 x1853164291762944/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.978227:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978253:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/1 (0 0) 00010000:00010000:1.0:1767317535.978264:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.978273:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.978307:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.978363:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.978370:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.978381:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.978404:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763072:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.978479:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.980961:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763072:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.980991:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981006:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981019:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981032:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981045:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981053:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981061:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317535.981073:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0000 x1853164291763072/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317535.981089:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981129:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/1 (0 0) 00010000:00010000:1.0:1767317535.981139:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981148:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.981217:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x19:0x0], updating i_size 8192 00000080:00010000:1.0:1767317535.981233:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d69e 00000080:00010000:1.0:1767317535.981259:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.981264:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d69e from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317535.981268:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981277:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317535.981309:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.981316:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8),name=d50c.sanity-flr 00000002:00010000:1.0:1767317535.981344:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x19:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981354:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981362:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.981368:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981378:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981383:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981388:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981391:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.981397:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981401:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981406:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981409:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981413:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.981419:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.981422:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.981424:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d69e 00000080:00010000:1.0:1767317535.981426:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d69e from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317535.981428:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981435:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.981444:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981447:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981451:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981456:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981460:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.981463:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981466:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981469:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981473:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981477:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.981540:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317535.981546:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.981552:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981556:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.981560:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317535.981562:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317535.981563:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d697 00000080:00010000:1.0:1767317535.981565:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d697 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317535.981567:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.981572:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.981577:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317535.981582:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=266 00000080:00200000:1.0:1767317535.981587:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317535.981596:0:83367:0:(file.c:1001:ll_file_open()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317535.982027:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x19:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317535.982099:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.982108:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317535.982140:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317535.982152:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291763328/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317535.982163:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317535.982311:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763328:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317535.982536:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317535.985750:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763328:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317535.985777:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985790:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985796:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985803:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985808:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985813:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317535.985817:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985822:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985846:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.985854:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317535.985862:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317535.986153:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317535.986236:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c1c00 x1853164291763328/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317535.986251:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291763328/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317535.986272:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317535.986316:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x19:0x0], updating i_size 4096 00000002:00100000:1.0:1767317535.986336:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1c00 x1853164291763328/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317535.986415:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317535.986422:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8),name=d50c.sanity-flr 00000002:00010000:1.0:1767317535.986444:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x19:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.986459:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986469:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.986476:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.986486:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986491:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986497:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986502:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.986516:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.986522:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986528:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986532:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986535:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.986541:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317535.986545:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317535.986548:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d69e 00000080:00010000:1.0:1767317535.986551:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d69e from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317535.986553:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986563:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.986572:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.986575:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986579:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986584:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986588:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.986591:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317535.986594:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986597:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986601:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986604:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317535.986637:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317535.986647:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.986666:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.986670:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.986675:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.987520:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763456:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.987673:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317535.993357:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763456:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317535.993982:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.993997:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317535.994026:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317535.994044:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317535.994059:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317535.994600:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763584:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317535.994711:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.003627:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763584:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317536.004533:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.004554:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.004654:0:83367:0:(file.c:424:ll_file_release()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), flags 704000 00000002:00100000:1.0:1767317536.004747:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1c00 x1853164291763328/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.004763:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.004770:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291763840/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.004800:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763840:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.004963:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.012623:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291763840:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.012671:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1c00 x1853164291763328/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317552 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.013197:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.013226:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.013249:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.013286:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.013296:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.013305:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.013309:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d697 00000080:00010000:1.0:1767317536.013319:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d697 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.013324:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.013333:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.013352:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.013362:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.013372:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.013383:0:83367:0:(file.c:1001:ll_file_open()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.013404:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x19:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317536.013471:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.013479:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.013494:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.013502:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291764096/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.013512:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.013548:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764096:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.013819:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.024108:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764096:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.024156:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 4/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024170:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 4/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024184:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024208:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.024227:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c0000 x1853164291764096/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.024243:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0000 x1853164291764096/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.024263:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024275:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/25 (0 0) 00000080:00200000:1.0:1767317536.024283:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.024325:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x19:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.024334:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6ba 00000080:00010000:1.0:1767317536.024365:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6ba from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317536.024370:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024380:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.024413:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0000 x1853164291764096/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.024502:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.024511:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8),name=d50c.sanity-flr 00000002:00010000:1.0:1767317536.024538:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x19:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.024549:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024560:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024570:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.024576:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024583:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024591:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024598:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024615:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.024624:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024633:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024640:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024647:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.024657:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317536.024663:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.024667:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x19:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d69e 00000080:00010000:1.0:1767317536.024672:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d69e from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.024675:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024682:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024694:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.024699:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024707:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024720:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024728:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024737:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.024742:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024750:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024757:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024763:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.024810:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317536.024826:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024854:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317536.024861:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024914:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317536.024945:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317536.024950:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024957:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.024969:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x240000405:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317536.024975:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.024982:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317536.024993:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317536.024995:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.025002:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.025044:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767317536.025075:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.025092:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x19:0x0](ffff8c3c485e21c8), flags=0 00000080:00200000:1.0:1767317536.025097:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x19:0x0](ffff8c3c485e21c8), intent=getattr 00000002:00010000:1.0:1767317536.025113:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.025170:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.025182:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.025207:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.025234:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764224:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.025372:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.035300:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764224:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.035336:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035365:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035374:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035387:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035399:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035413:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035420:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.035451:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.035463:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1c00 x1853164291764224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/872 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.035475:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 288 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.035489:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.035501:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/26 (0 0) 00000080:00200000:1.0:1767317536.035508:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.035550:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1a:0x0](ffff8c3c485e1988) 00000080:00200000:1.0:1767317536.035665:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x1a:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:1.0:1767317536.035671:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1a:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d6c1 00000080:00010000:1.0:1767317536.035683:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1a:0x0](ffff8c3c485e1988) 00000080:00010000:1.0:1767317536.035688:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c1 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317536.035691:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.035701:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317536.035743:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.035752:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x19:0x0](ffff8c3c485e21c8) 00010000:00010000:1.0:1767317536.035796:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.038468:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317536.038513:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x1a:0x0]: losing layout lock 00010000:00010000:1.0:1767317536.038591:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.038599:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.038605:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317536.038609:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7338b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.038633:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7333e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.038656:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.038673:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1c00 x1853164291764480/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.038706:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764480:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.038850:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.043498:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764480:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.043579:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x1a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317536.043594:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x1a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317536.043598:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317536.043626:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317536.043673:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x1a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317536.043683:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1a:0x0](ffff8c3c485e1988) 00000080:00200008:1.0:1767317536.043809:0:83367:0:(file.c:424:ll_file_release()) START file d50c.sanity-flr:[0x200000405:0x19:0x0](ffff8c3c485e21c8), flags 704000 00010000:00010000:1.0:1767317536.043844:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.043927:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.043948:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.043959:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.043969:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.043976:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.043983:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.043987:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d697 00000080:00010000:1.0:1767317536.043996:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d697 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317536.044000:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.044009:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.044026:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.044038:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=0 00000080:00200000:1.0:1767317536.044044:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.044052:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.044057:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.044072:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.044079:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.044083:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.044086:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d697 00000080:00010000:1.0:1767317536.044090:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d697 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317536.044093:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.044101:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.044109:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.044116:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317536.044142:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.044171:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.044241:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0000 x1853164291764096/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.044255:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.044261:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291764736/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.044287:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764736:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.044423:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.052779:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764736:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.052840:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0000 x1853164291764096/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317536.052949:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053012:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053022:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053029:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053036:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317536.053039:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6ba lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73368 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053055:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d69e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73330 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.053069:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73314 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.053092:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.053099:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0a80 x1853164291764992/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.053149:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764992:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.053267:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.059441:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317536.059556:0:42090:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317536.059584:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379233280 00000100:00100000:2.0:1767317536.059597:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379233280 00000100:00100000:2.0:1767317536.059670:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9524 00000100:00100000:2.0:1767317536.059683:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379233280:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317536.059704:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.059803:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317536.059837:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:52832:x1853164379233280:12345-192.168.202.133@tcp:104: Request processed in 148us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317536.059846:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9524 00010000:00010000:1.0:1767317536.060071:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317536.060081:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060091:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317536.060098:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060107:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060116:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060266:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060274:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317536.060300:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060307:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6ac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7334c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.060326:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317536.060328:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317536.060337:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.060400:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291765120:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.067797:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291765120:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.088306:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0a80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291764992:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.088372:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x19:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.088493:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.088523:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.088602:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.088613:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.088624:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.088650:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765248:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.088789:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.099730:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765248:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.099772:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.099789:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.099805:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.099818:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.099854:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.100443:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.100449:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.100459:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291765248/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.100471:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.100483:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317536.100490:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.100521:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.100526:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d6c8 00000080:00010000:1.0:1767317536.100531:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.100534:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c8 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317536.100536:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.100543:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.100569:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.100589:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317536.100593:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.100620:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.100684:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.100692:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.100702:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.100728:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765376:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.100856:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.112581:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765376:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.112618:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112648:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112658:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112674:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112687:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112702:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112711:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112741:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.112755:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291765376/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.112770:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.112783:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/12 (0 0) 00000002:00010000:1.0:1767317536.112807:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.115485:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.115509:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.115527:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.115581:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765504:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.115733:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.130075:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765504:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.130101:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130114:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130152:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130162:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130174:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130182:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130199:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.130212:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291765504/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.130226:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130250:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/12 (0 0) 00000080:00200000:1.0:1767317536.130276:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.130322:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.130332:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xc:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.130342:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for remote lock 0x73c3d5cb1442d6d6 00000080:00010000:1.0:1767317536.130348:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6cf 00000080:00010000:1.0:1767317536.130361:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.130371:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6cf from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.130376:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130386:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317536.130403:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d6d6 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.130407:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130414:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.130449:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.130459:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8),name=d50d.sanity-flr 00000002:00010000:1.0:1767317536.130486:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.130494:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130503:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.130508:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.130512:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.130514:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6d6 00000080:00010000:1.0:1767317536.130517:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6d6 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317536.130519:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130532:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.130606:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.130614:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.130622:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130632:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.130638:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.130642:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.130644:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d6c8 00000080:00010000:1.0:1767317536.130648:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c8 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.130651:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.130657:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.130666:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.130674:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50d.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.130680:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.130691:0:83367:0:(file.c:1001:ll_file_open()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.130709:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317536.130780:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.130792:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.130806:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.130815:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0e00 x1853164291765760/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.130825:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.130846:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765760:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.139405:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.149917:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765760:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.149950:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.149967:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.149975:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.149983:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150016:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150023:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.150028:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150037:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150045:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150052:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317536.150061:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.150067:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317536.150100:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c0e00 x1853164291765760/t4294976338(4294976338) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.150115:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0e00 x1853164291765760/t4294976338(4294976338) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.150129:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.150155:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xc:0x0], updating i_size 4096 00000002:00100000:0.0:1767317536.150180:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0e00 x1853164291765760/t4294976338(4294976338) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.150281:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.150294:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8),name=d50d.sanity-flr 00000002:00010000:0.0:1767317536.150325:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.150340:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.150353:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.150362:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.150369:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00010000:0.0:1767317536.150373:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6d6 00000080:00010000:0.0:1767317536.150380:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6d6 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.150383:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.150392:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.150431:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317536.150446:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x240000404:0xc:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.150452:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.150460:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.151212:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765888:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317536.151348:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.178432:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291765888:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317536.181125:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.181150:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.181405:0:83367:0:(file.c:424:ll_file_release()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), flags 704000 00000002:00100000:1.0:1767317536.181481:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0e00 x1853164291765760/t4294976338(4294976338) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.181494:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.181500:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291766144/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.181525:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766144:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.181652:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.186712:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766144:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.186763:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0e00 x1853164291765760/t4294976338(4294976338) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.186947:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.186975:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.186997:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.190934:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.190949:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.190963:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.190968:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d6c8 00000080:00010000:1.0:1767317536.190978:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c8 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.190983:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.190993:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.191014:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.191029:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50d.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.191041:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.191053:0:83367:0:(file.c:1001:ll_file_open()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.191090:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317536.191174:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.191182:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.191227:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.191242:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291766400/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.191253:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.191297:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766400:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.191579:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684aa80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.205019:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766400:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.205083:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.205097:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.205117:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.205133:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.205150:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c0700 x1853164291766400/t4294976340(4294976340) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.205163:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291766400/t4294976340(4294976340) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.205196:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.205209:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/12 (0 0) 00000080:00200000:1.0:1767317536.205217:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.205245:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xc:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.205251:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6e4 00000080:00010000:1.0:1767317536.205284:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6e4 from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317536.205290:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.205301:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.209131:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291766400/t4294976340(4294976340) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.213079:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.213103:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8),name=d50d.sanity-flr 00000002:00010000:0.0:1767317536.213150:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.213193:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.213213:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.213224:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.213234:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00010000:0.0:1767317536.213239:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6d6 00000080:00010000:0.0:1767317536.213248:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6d6 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.213252:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.213262:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.213320:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317536.213376:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317536.213411:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.213432:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50d.sanity-flr, dir=[0x240000404:0xc:0x0](ffff8c3c485e21c8), flags=0 00000080:00200000:0.0:1767317536.213437:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50d.sanity-flr, dir=[0x240000404:0xc:0x0](ffff8c3c485e21c8), intent=getattr 00000002:00010000:0.0:1767317536.213451:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000404:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.213514:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.213520:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.213528:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.213556:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766528:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.213687:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.220296:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766528:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.220332:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220366:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220374:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220388:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220401:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220434:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220443:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.220450:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.220462:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efc380 x1853164291766528/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.220476:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.220492:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.220502:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/13 (0 0) 00000080:00200000:0.0:1767317536.220511:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000404:0xc:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.220550:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0xd:0x0](ffff8c3c48515b88) 00000080:00200000:0.0:1767317536.220638:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xd:0x0], updating i_size 1065984 00000080:00200000:0.0:1767317536.220669:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0xd:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:0.0:1767317536.220686:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xd:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d6eb 00000080:00010000:0.0:1767317536.220698:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xd:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317536.220702:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6eb from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317536.220705:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.220724:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.220765:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.220774:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50d.sanity-flr, dir=[0x240000404:0xc:0x0](ffff8c3c485e21c8) 00010000:00010000:0.0:1767317536.220820:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.221165:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.221179:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0xd:0x0]: losing layout lock 00010000:00010000:0.0:1767317536.221231:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 1/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.221239:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.221246:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.221249:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d6eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73448 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.221265:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d6d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73409 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.221285:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.221294:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efc380 x1853164291766784/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.221340:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766784:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.221463:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.227124:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766784:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.227286:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0xd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317536.227305:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0xd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317536.227309:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317536.227317:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:0.0:1767317536.227331:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00000080:00200000:0.0:1767317536.227369:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0xd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317536.227380:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0xd:0x0](ffff8c3c48515b88) 00000080:00200008:0.0:1767317536.227520:0:83367:0:(file.c:424:ll_file_release()) START file d50d.sanity-flr:[0x240000404:0xc:0x0](ffff8c3c485e21c8), flags 704000 00010000:00010000:0.0:1767317536.227557:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.227624:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.227646:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.227657:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.227668:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.228581:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.228593:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.228599:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d6c8 00000080:00010000:0.0:1767317536.228609:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c8 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317536.228615:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.228650:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.228672:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317536.228917:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:3.0:1767317536.228924:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317536.228951:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.229026:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317536.229035:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317536.229047:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317536.229084:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766912:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317536.229237:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eba80 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.233347:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291766912:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.233384:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233404:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233413:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233427:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233438:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233453:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233462:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233470:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.233506:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1880 x1853164291766912/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.233521:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233535:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233549:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233557:0:83367:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233564:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233571:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.233606:0:83367:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:1.0:1767317536.233628:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0xc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.233701:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.233709:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.233718:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.233750:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767040:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.233865:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00010000:00010000:0.0:1767317536.234026:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317536.234036:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234046:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c60c91c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.234053:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234063:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234072:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234094:0:42099:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234131:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234139:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317536.234166:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234174:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91c00/0x73c3d5cb1442d6f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73480 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.234210:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.234212:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.234214:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.234231:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291767168:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.238567:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291767168:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.241733:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767040:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.241769:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.241785:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.241801:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.241815:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.241831:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.241840:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242139:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.242154:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291767040/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.242264:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242307:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/12 (0 0) 00000080:00200000:1.0:1767317536.242335:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.242366:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xc:0x0], updating i_size 4096 00000080:00200000:1.0:1767317536.242370:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x240000404:0xc:0x0](ffff8c3c485e21c8): rc = 0 00000080:00010000:1.0:1767317536.242378:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for remote lock 0x73c3d5cb1442d6f9 00000080:00010000:1.0:1767317536.242384:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d6cf 00000080:00010000:1.0:1767317536.242398:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.242403:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6cf from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317536.242408:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242418:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317536.242435:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d6f9 from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317536.242438:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242445:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.242471:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.242496:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.242507:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242520:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.242533:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.242538:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.242542:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d6c8 00000080:00010000:1.0:1767317536.242546:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d6c8 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317536.242549:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242556:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.242566:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.242575:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317536.242601:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242653:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 1/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.242660:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317536.243408:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291767296:192.168.202.133@tcp:103:rm.0 00010000:00010000:1.0:1767317536.244008:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d6cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a733fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.244055:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.244082:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.244131:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0700 x1853164291766400/t4294976340(4294976340) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.244160:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.244166:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291767552/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.244366:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767552:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.244477:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.251085:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767552:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.251125:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0700 x1853164291766400/t4294976340(4294976340) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317536.251242:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.251254:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.251260:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317536.251264:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d6f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7348e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.251277:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d6e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73425 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.251302:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.251308:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3100 x1853164291767808/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.251334:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767808:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.251467:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291767296:192.168.202.133@tcp:103:rm.0 00000100:00100000:1.0:1767317536.251487:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317536.254432:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317536.254554:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379234176 00000100:00100000:3.0:1767317536.254571:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379234176 00000100:00100000:3.0:1767317536.254671:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9525 00000100:00100000:3.0:1767317536.254694:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379234176:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317536.254716:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.254812:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317536.254820:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379234176:12345-192.168.202.133@tcp:104: Request processed in 130us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317536.254847:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9525 00010000:00010000:0.0:1767317536.254924:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317536.254934:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.254943:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.254950:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.254960:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.254970:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.255042:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.255050:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317536.255087:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.255093:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d6c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a733df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.255113:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.255114:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.255115:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.255123:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317536.255137:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291767936:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.260585:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291767936:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.263630:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291767808:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.263699:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0xc:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.263814:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.263849:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.264108:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.264120:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.264131:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.264157:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768064:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.268510:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.271150:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768064:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.271205:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271221:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271237:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271252:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271299:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271309:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271316:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.271330:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291768064/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.271348:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271366:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317536.271376:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.271414:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.271420:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d700 00000080:00010000:1.0:1767317536.271426:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.271429:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d700 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317536.271431:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.271438:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.271467:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.271497:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317536.271501:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.271534:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.271583:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.271588:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.271596:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.271617:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768192:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.271723:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.275087:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768192:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.275123:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275149:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275157:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275327:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275342:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275381:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275390:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275398:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.275410:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291768192/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.275425:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275435:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/29 (0 0) 00000080:00200000:1.0:1767317536.275442:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.275477:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00200000:1.0:1767317536.275484:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1d:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.275491:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d707 00000080:00010000:1.0:1767317536.275504:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00010000:1.0:1767317536.275508:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d707 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.275510:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275516:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.275556:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.275567:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988),name=d60a.sanity-flr 00000002:00010000:1.0:1767317536.275593:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.275601:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275610:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.275614:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.275617:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00010000:1.0:1767317536.275619:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d707 00000080:00010000:1.0:1767317536.275622:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d707 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317536.275624:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275629:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.275695:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.275704:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.275710:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275717:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.275723:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.275726:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.275728:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d700 00000080:00010000:1.0:1767317536.275739:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d700 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.275742:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.275749:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.275758:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.275765:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60a.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.275770:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.275779:0:83367:0:(file.c:1001:ll_file_open()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), flags 704400 00000002:00010000:1.0:1767317536.275794:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317536.275845:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.275852:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.275865:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.279413:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291768448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.279433:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.279487:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768448:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.279745:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.283195:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768448:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.283227:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283274:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283283:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283291:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283300:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283307:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317536.283312:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283320:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283328:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283336:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317536.283343:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.283349:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317536.283372:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c0700 x1853164291768448/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.283387:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291768448/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.283405:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.283429:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1d:0x0], updating i_size 4096 00000002:00100000:1.0:1767317536.283447:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291768448/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.283528:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.283537:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988),name=d60a.sanity-flr 00000002:00010000:1.0:1767317536.283564:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.283582:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.283594:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.283601:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.283607:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00010000:1.0:1767317536.283611:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d707 00000080:00010000:1.0:1767317536.283616:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d707 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.283620:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.283628:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.283671:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767317536.283687:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000405:0x1d:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317536.283693:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.283711:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317536.284375:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768576:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317536.284484:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.298147:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768576:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317536.299324:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.299346:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767317536.299953:0:83367:0:(file.c:424:ll_file_release()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), flags 704000 00000002:00100000:2.0:1767317536.300047:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0700 x1853164291768448/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317536.300059:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317536.300064:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38000 x1853164291768832/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317536.300089:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768832:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317536.300769:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 11 seconds 00000100:00100000:3.0:1767317536.303622:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291768832:192.168.202.133@tcp:35:rm.0 00000002:00100000:3.0:1767317536.303663:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0700 x1853164291768448/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767317536.303754:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317536.303776:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.303796:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.303809:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.303818:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317536.303825:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317536.304035:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d700 00000080:00010000:3.0:1767317536.304050:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d700 from it ffffa7f7c1c1fbf8 00010000:00010000:3.0:1767317536.304055:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.304065:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.304083:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317536.304090:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60a.sanity-flr, flags=266 00000080:00200000:3.0:1767317536.304099:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988), inode mode 41ed mask 44 00000080:00200008:3.0:1767317536.304108:0:83367:0:(file.c:1001:ll_file_open()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), flags 704400 00000002:00010000:3.0:1767317536.304126:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:3.0:1767317536.304215:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317536.304223:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:3.0:1767317536.304247:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767317536.304255:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc2680 x1853164291769088/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767317536.304265:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317536.304288:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769088:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317536.304499:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.307710:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769088:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317536.307756:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.307767:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.307779:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.307788:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317536.307803:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c58fc2680 x1853164291769088/t8589937421(8589937421) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767317536.307852:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc2680 x1853164291769088/t8589937421(8589937421) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317536.307863:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.307903:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/29 (0 0) 00000080:00200000:3.0:1767317536.307912:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317536.307943:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1d:0x0], updating i_size 4096 00000080:00010000:3.0:1767317536.307950:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d715 00000080:00010000:3.0:1767317536.307960:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d715 from it ffffa7f7c1c1fbd0 00010000:00010000:3.0:1767317536.307965:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.307976:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317536.308013:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c58fc2680 x1853164291769088/t8589937421(8589937421) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767317536.308098:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317536.308105:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988),name=d60a.sanity-flr 00000002:00010000:3.0:1767317536.308128:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.308137:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.308147:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.308162:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317536.308169:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00010000:3.0:1767317536.308173:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d707 00000080:00010000:3.0:1767317536.308178:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d707 from it ffffa7f7c1c1fcd8 00010000:00010000:3.0:1767317536.308181:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.308198:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.308250:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988) pos/size0/4096 32bit_api 0 00000080:00200000:3.0:1767317536.308280:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:3.0:1767317536.308310:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988), inode mode 41ed mask 1 00000080:00200000:3.0:1767317536.308328:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1d:0x0](ffff8c3c485e1988), flags=0 00000080:00200000:3.0:1767317536.308332:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1d:0x0](ffff8c3c485e1988), intent=getattr 00000002:00010000:3.0:1767317536.308344:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x1d:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.308391:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317536.308396:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317536.308404:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317536.308423:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769216:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317536.308522:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.313861:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769216:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317536.313956:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.313986:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.313995:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314011:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314026:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314041:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314048:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314054:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317536.314062:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc2d80 x1853164291769216/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317536.314072:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317536.314096:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317536.314106:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/30 (0 0) 00000080:00200000:3.0:1767317536.314113:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x1d:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317536.314158:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1e:0x0](ffff8c3c597d80c8) 00000080:00200000:3.0:1767317536.314485:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1e:0x0], updating i_size 2147483648 00000080:00200000:3.0:1767317536.314512:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x1e:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:3.0:1767317536.314517:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1e:0x0](ffff8c3c597d80c8) for lock 0x73c3d5cb1442d71c 00000080:00010000:3.0:1767317536.314529:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1e:0x0](ffff8c3c597d80c8) 00000080:00010000:3.0:1767317536.314531:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d71c from it ffffa7f7c1c1fdf8 00010000:00010000:3.0:1767317536.314534:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317536.314542:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317536.314576:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988), inode mode 41ed mask 3 00000080:00200000:3.0:1767317536.314584:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1d:0x0](ffff8c3c485e1988) 00010000:00010000:3.0:1767317536.314620:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314639:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314745:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317536.314768:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x1e:0x0]: losing layout lock 00010000:00010000:3.0:1767317536.314803:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317536.314808:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.314812:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317536.314814:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91a00/0x73c3d5cb1442d71c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73528 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317536.314826:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d707 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a734e9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317536.315000:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317536.315009:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc2d80 x1853164291769472/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317536.315036:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769472:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317536.315145:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.319479:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769472:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317536.319544:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x1e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317536.319556:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x1e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317536.319559:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317536.319566:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767317536.319594:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x1e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317536.319601:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1e:0x0](ffff8c3c597d80c8) 00000080:00200008:3.0:1767317536.319716:0:83367:0:(file.c:424:ll_file_release()) START file d60a.sanity-flr:[0x200000405:0x1d:0x0](ffff8c3c485e1988), flags 704000 00010000:00010000:3.0:1767317536.319749:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.319801:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317536.319818:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.319827:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.319847:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.319855:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317536.319862:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317536.319865:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d700 00000080:00010000:3.0:1767317536.319956:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d700 from it ffffa7f7c1c1fc10 00010000:00010000:3.0:1767317536.319962:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.319971:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.319989:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317536.320009:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:3.0:1767317536.320013:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317536.320154:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.320221:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.320229:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.320250:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.320280:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769600:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.320401:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.329814:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769600:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317536.329861:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330401:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330409:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330423:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330436:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330450:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330458:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330465:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317536.330478:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3bb80 x1853164291769600/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317536.330490:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330500:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/29 (0 0) 00000080:00200000:3.0:1767317536.330510:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317536.330548:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1d:0x0], updating i_size 4096 00000080:00200000:3.0:1767317536.330552:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x1d:0x0](ffff8c3c485e1988): rc = 0 00000080:00010000:3.0:1767317536.330560:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) for lock 0x73c3d5cb1442d723 00000080:00010000:3.0:1767317536.330576:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00010000:3.0:1767317536.330581:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d723 from it ffffa7f7c1c1fe00 00010000:00010000:3.0:1767317536.330584:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330594:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.330638:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317536.330665:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317536.330686:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330699:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.330706:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317536.330711:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317536.330714:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d700 00000080:00010000:3.0:1767317536.330718:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d700 from it ffffa7f7c1c1fd88 00010000:00010000:3.0:1767317536.330721:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330728:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317536.330737:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767317536.330752:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:3.0:1767317536.330779:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330810:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.330822:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317536.330933:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c58fc2680 x1853164291769088/t8589937421(8589937421) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767317536.330947:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767317536.330952:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc0e00 x1853164291769856/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767317536.330979:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769856:192.168.202.133@tcp:35:rm.0 00000100:00100000:3.0:1767317536.331102:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1767317536.337726:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291769856:192.168.202.133@tcp:35:rm.0 00000002:00100000:2.0:1767317536.337920:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c58fc2680 x1853164291769088/t8589937421(8589937421) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767317536.338038:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.338071:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.338076:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.338080:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1767317536.338083:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0e00/0x73c3d5cb1442d723 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73560 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.338095:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90600/0x73c3d5cb1442d715 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73505 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.338107:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a734cd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317536.338125:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317536.338130:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3bb80 x1853164291770112/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317536.338151:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770112:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317536.338302:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.342261:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3bb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770112:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.342328:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1d:0x0](ffff8c3c485e1988) 00000080:00200000:0.0:1767317536.342545:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.342570:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.342634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.342643:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.342651:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.342669:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770240:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.342808:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.355094:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770240:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.355139:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355150:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355163:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355175:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355196:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355205:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355213:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.355226:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efed80 x1853164291770240/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.355252:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355269:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317536.355277:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.355312:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.355323:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d72a 00000080:00010000:0.0:1767317536.355329:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.355332:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d72a from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317536.355334:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.355341:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.355366:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.355389:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317536.355393:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317536.355420:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.355466:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.355471:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.355479:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.355497:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770368:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.355590:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.360980:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770368:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.361015:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361042:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361071:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361086:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361097:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361112:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361120:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361127:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.361139:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efed80 x1853164291770368/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.361155:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.361167:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/33 (0 0) 00000080:00200000:0.0:1767317536.361175:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.361238:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88) 00000002:00010000:0.0:1767317536.361274:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.361336:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.361353:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.361363:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.361388:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770496:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.361497:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.366032:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770496:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.366067:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366081:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366095:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366107:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366122:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366131:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366139:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.366174:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efdf80 x1853164291770496/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.366201:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366217:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/4 (0 0) 00010000:00010000:0.0:1767317536.366228:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.366311:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.366350:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.366421:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.366429:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.366439:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.366465:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770624:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.366562:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.371617:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770624:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.371655:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 4/1,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.371795:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 4/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.371810:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.371822:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.371836:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372101:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372112:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.372128:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efdf80 x1853164291770624/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.372146:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372371:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/4 (0 0) 00010000:00010000:0.0:1767317536.372384:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372392:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.372445:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x21:0x0], updating i_size 8192 00000080:00010000:0.0:1767317536.372460:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d731 00000080:00010000:0.0:1767317536.372478:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317536.372482:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d731 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317536.372487:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372495:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317536.372532:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.372539:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88),name=d60b.sanity-flr 00000002:00010000:0.0:1767317536.372568:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.372579:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372591:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.372600:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.372606:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372614:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372621:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372633:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.372642:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.372648:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372655:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372662:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372668:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.372783:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317536.372788:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317536.372792:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d731 00000080:00010000:0.0:1767317536.372797:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d731 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317536.372801:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372809:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.372821:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.372828:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.372842:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373069:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373077:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.373086:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.373093:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373100:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373107:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373114:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.373390:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.373405:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.373413:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373422:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.373442:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.373448:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.373451:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d72a 00000080:00010000:0.0:1767317536.373455:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d72a from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.373459:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.373465:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.373475:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.373483:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.373490:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88), inode mode 41ed mask 44 00000080:00200008:0.0:1767317536.373500:0:83367:0:(file.c:1001:ll_file_open()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), flags 704400 00000002:00010000:0.0:1767317536.373520:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317536.373587:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.373595:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.373610:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.373622:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efed80 x1853164291770880/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.373632:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.373659:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770880:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.374568:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.379466:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291770880:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.379498:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379514:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379523:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379530:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379538:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379545:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.379550:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379557:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379564:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379572:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317536.379579:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.379586:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317536.379631:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efed80 x1853164291770880/t8589937425(8589937425) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.379646:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efed80 x1853164291770880/t8589937425(8589937425) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.379666:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.382113:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x21:0x0], updating i_size 4096 00000002:00100000:0.0:1767317536.382250:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efed80 x1853164291770880/t8589937425(8589937425) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.382355:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.382364:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88),name=d60b.sanity-flr 00000002:00010000:0.0:1767317536.382394:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.382418:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382436:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.382448:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.382456:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382464:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382476:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382502:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.382523:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.382532:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382540:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382547:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382554:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.382564:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317536.382570:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317536.382574:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d731 00000080:00010000:0.0:1767317536.382579:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d731 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.382582:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382590:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.382603:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.382608:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382622:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382630:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382638:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.382646:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.382650:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382657:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382664:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.382671:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.383516:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317536.383537:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.383570:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.383577:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.383594:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.384578:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771008:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317536.384820:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.393589:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771008:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317536.394426:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.394447:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.394479:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.394496:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.394512:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.395177:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771136:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317536.395349:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.406604:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771136:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317536.407441:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.407462:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767317536.408121:0:83367:0:(file.c:424:ll_file_release()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), flags 704000 00000002:00100000:2.0:1767317536.408312:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efed80 x1853164291770880/t8589937425(8589937425) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317536.408328:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317536.408334:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38000 x1853164291771392/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317536.408375:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771392:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317536.408656:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.413342:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771392:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317536.413387:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efed80 x1853164291770880/t8589937425(8589937425) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.413490:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.413514:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.413535:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.413550:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.413558:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.413565:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.413569:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d72a 00000080:00010000:0.0:1767317536.413577:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d72a from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.413581:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.413591:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.413608:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.413616:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.413623:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88), inode mode 41ed mask 44 00000080:00200008:0.0:1767317536.413634:0:83367:0:(file.c:1001:ll_file_open()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), flags 704400 00000002:00010000:0.0:1767317536.413649:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317536.413733:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.413741:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.413753:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.413759:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efed80 x1853164291771648/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.413768:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.413789:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771648:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.414439:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.418798:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771648:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.419048:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419062:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419078:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419091:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.419112:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c42efed80 x1853164291771648/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.419155:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efed80 x1853164291771648/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.419249:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419263:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/33 (0 0) 00000080:00200000:0.0:1767317536.419271:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.419321:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x21:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.419331:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d74d 00000080:00010000:0.0:1767317536.419342:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d74d from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317536.419347:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419359:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.419396:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efed80 x1853164291771648/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.419498:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.419508:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88),name=d60b.sanity-flr 00000002:00010000:0.0:1767317536.419535:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.419547:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419559:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.419584:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.419591:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419598:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419606:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419613:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.419621:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.419628:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419636:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419642:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419649:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.419658:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317536.419663:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317536.419668:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x21:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442d731 00000080:00010000:0.0:1767317536.419775:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d731 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.419778:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419786:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.419799:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.419806:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419814:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419822:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.419829:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.419838:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.419843:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420150:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420158:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420303:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.420349:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317536.420364:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.420392:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.420399:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420406:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317536.420421:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317536.420426:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420433:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.420444:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x4:0x0]) in obj [0x240000405:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.420449:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420455:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767317536.420466:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767317536.420477:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.420483:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.420525:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:0.0:1767317536.420554:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.420577:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x21:0x0](ffff8c3c48515b88), flags=0 00000080:00200000:0.0:1767317536.420582:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x21:0x0](ffff8c3c48515b88), intent=getattr 00000002:00010000:0.0:1767317536.420601:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f60b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.420661:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.420670:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.420780:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.420811:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771776:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.421342:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.425518:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291771776:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.425555:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425585:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425593:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425623:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425636:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425650:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425658:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.425665:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.425691:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efdf80 x1853164291771776/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/720 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.425705:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.425720:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.425731:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/34 (0 0) 00000080:00200000:0.0:1767317536.425739:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x4:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.425780:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x22:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317536.425930:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x22:0x0]: layout version change: 4294967294 -> 41 00000080:00010000:0.0:1767317536.425937:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x22:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d754 00000080:00010000:0.0:1767317536.425958:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x22:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.425962:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d754 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317536.425966:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.425975:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.426014:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.426023:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x21:0x0](ffff8c3c48515b88) 00010000:00010000:0.0:1767317536.426066:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.426165:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.426177:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x22:0x0]: losing layout lock 00010000:00010000:0.0:1767317536.426229:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.426237:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.426244:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.426247:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d754 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a735fa expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.426263:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d738 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a735ad expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.426283:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.426296:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efdf80 x1853164291772032/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.426326:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772032:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.426444:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.432755:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdf80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772032:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.432825:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x22:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317536.432842:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317536.432925:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x22:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317536.432936:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x22:0x0](ffff8c3c485163c8) 00000080:00200008:0.0:1767317536.433043:0:83367:0:(file.c:424:ll_file_release()) START file d60b.sanity-flr:[0x200000405:0x21:0x0](ffff8c3c48515b88), flags 704000 00010000:00010000:0.0:1767317536.433077:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.433129:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.433162:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.433190:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.433200:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.433207:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.433215:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.433218:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d72a 00000080:00010000:0.0:1767317536.433226:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d72a from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317536.433230:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.433265:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.433284:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.433296:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=0 00000080:00200000:0.0:1767317536.433304:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.433312:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.433318:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.433326:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.433332:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.433336:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.433339:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d72a 00000080:00010000:0.0:1767317536.433342:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d72a from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317536.433346:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.433353:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.433360:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.433366:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317536.433391:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.433431:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.433489:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efed80 x1853164291771648/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317536.433502:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317536.433508:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42eff100 x1853164291772288/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317536.433533:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772288:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317536.433649:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.439404:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772288:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317536.439447:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efed80 x1853164291771648/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317536.439507:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439561:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439569:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439577:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439582:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767317536.439601:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d74d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x21:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a735d7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439615:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d731 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7359f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.439630:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d72a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73583 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.439651:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.439657:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42eff100 x1853164291772544/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.439682:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772544:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.439779:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:2.0:1767317536.445021:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317536.445171:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379236096 00000100:00100000:3.0:1767317536.445195:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379236096 00000100:00100000:3.0:1767317536.445265:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9526 00000100:00100000:3.0:1767317536.445278:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379236096:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317536.445300:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317536.445407:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317536.445414:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379236096:12345-192.168.202.133@tcp:104: Request processed in 140us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317536.445442:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9526 00010000:00010000:0.0:1767317536.445631:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317536.445642:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445651:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.445656:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445665:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445674:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445809:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445824:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317536.445866:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 1/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445898:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d73f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a735bb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.445919:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.445921:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.445923:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317536.446149:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291772672:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.462074:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291772672:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.499255:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff100 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772544:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317536.499526:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x21:0x0](ffff8c3c48515b88) 00000080:00200000:2.0:1767317536.499658:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317536.499702:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.499787:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.499799:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.499811:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.499837:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772800:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.500433:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317536.504993:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772800:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317536.505030:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505045:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505060:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505074:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505112:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505121:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505129:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317536.505143:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3a680 x1853164291772800/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317536.505159:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505194:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767317536.505203:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317536.505405:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317536.505416:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d75b 00000080:00010000:2.0:1767317536.505424:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317536.505427:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d75b from it ffffa7f7c1c1fb58 00010000:00010000:2.0:1767317536.505431:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.505441:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317536.505476:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317536.505512:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:2.0:1767317536.505519:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317536.505552:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.505611:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.505619:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.505632:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.505660:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772928:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.505783:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317536.511125:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291772928:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317536.511163:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511214:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511223:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511351:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511366:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511405:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511414:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511421:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317536.511434:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3a680 x1853164291772928/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317536.511447:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.511459:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/15 (0 0) 00000002:00010000:2.0:1767317536.511479:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0xf:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.511540:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.511548:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.511557:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.511581:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773056:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.511739:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.516719:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773056:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.516753:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516769:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516782:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516795:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516808:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516817:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.516861:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.517088:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b800 x1853164291773056/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.517105:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517122:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/15 (0 0) 00000080:00200000:0.0:1767317536.517146:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.517211:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317536.517222:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xf:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.517360:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for remote lock 0x73c3d5cb1442d769 00000080:00010000:0.0:1767317536.517368:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d762 00000080:00010000:0.0:1767317536.517382:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.517386:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d762 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317536.517391:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517401:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317536.517417:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d769 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317536.517420:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517428:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317536.517469:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.517477:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8),name=d61a.sanity-flr 00000002:00010000:0.0:1767317536.517508:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.517517:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517528:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.517535:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.517540:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.517543:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d769 00000080:00010000:0.0:1767317536.517547:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d769 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317536.517550:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517557:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.517624:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.517633:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.517641:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517650:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.517656:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.517665:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.517668:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d75b 00000080:00010000:0.0:1767317536.517673:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d75b from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.517676:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.517684:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.517693:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.517701:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61a.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.517707:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8), inode mode 41ed mask 44 00000100:00100000:0.0:1767317536.517766:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773184:192.168.202.133@tcp:49:rm.0 00000100:00100000:0.0:1767317536.518430:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.524651:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773184:192.168.202.133@tcp:49:rm.0 00000080:00200008:0.0:1767317536.524708:0:83367:0:(file.c:1001:ll_file_open()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), flags 704400 00000002:00010000:0.0:1767317536.524751:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317536.525105:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.525117:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.525132:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.525142:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd500 x1853164291773440/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.525152:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.526375:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773440:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.526746:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.545633:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773440:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.545662:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545694:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545703:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545711:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545720:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545728:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.545733:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545740:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545748:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545755:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317536.545764:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.545801:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317536.545851:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efd500 x1853164291773440/t4294976347(4294976347) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.545869:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd500 x1853164291773440/t4294976347(4294976347) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.545943:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.545971:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xf:0x0], updating i_size 4096 00000002:00100000:0.0:1767317536.546001:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd500 x1853164291773440/t4294976347(4294976347) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.546093:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.546103:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8),name=d61a.sanity-flr 00000002:00010000:0.0:1767317536.546133:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.546151:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.546165:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.546173:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.546179:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.546196:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d769 00000080:00010000:0.0:1767317536.546202:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d769 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.546207:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.546229:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.546561:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317536.546578:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x240000404:0xf:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.546586:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.546595:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317536.552361:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773568:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317536.552586:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.568396:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773568:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317536.570379:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.570407:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.570494:0:83367:0:(file.c:424:ll_file_release()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), flags 704000 00000002:00100000:1.0:1767317536.570619:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efd500 x1853164291773440/t4294976347(4294976347) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.570634:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.570640:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291773824/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.570761:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773824:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.571197:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.582412:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773824:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.582467:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efd500 x1853164291773440/t4294976347(4294976347) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.582577:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.582605:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.582631:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.582648:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.582656:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.582663:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.582667:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d75b 00000080:00010000:1.0:1767317536.582687:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d75b from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.582691:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.582701:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.582740:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.582750:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61a.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.582760:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8), inode mode 41ed mask 44 00000100:00100000:1.0:1767317536.582822:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773952:192.168.202.133@tcp:49:rm.0 00000100:00100000:1.0:1767317536.583311:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.586191:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291773952:192.168.202.133@tcp:49:rm.0 00000080:00200008:1.0:1767317536.586249:0:83367:0:(file.c:1001:ll_file_open()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), flags 704400 00000002:00010000:1.0:1767317536.586291:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317536.586382:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.586393:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.586405:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.586415:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291774208/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.586426:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.586450:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774208:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.586711:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.596282:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774208:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.596347:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596388:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 4/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596403:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596416:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.596436:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c2300 x1853164291774208/t4294976349(4294976349) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.596452:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291774208/t4294976349(4294976349) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.596466:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596479:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/15 (0 0) 00000080:00200000:1.0:1767317536.596488:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.596518:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xf:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.596524:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d777 00000080:00010000:1.0:1767317536.596534:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d777 from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317536.596539:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596549:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.596597:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291774208/t4294976349(4294976349) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.596710:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.596721:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8),name=d61a.sanity-flr 00000002:00010000:1.0:1767317536.596754:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.596766:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596781:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.596788:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.596794:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00010000:1.0:1767317536.596798:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d769 00000080:00010000:1.0:1767317536.596803:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d769 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.596806:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.596813:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.597139:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767317536.597195:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767317536.597226:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8), inode mode 41ed mask 1 00000100:00100000:1.0:1767317536.597297:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774336:192.168.202.133@tcp:49:rm.0 00000100:00100000:1.0:1767317536.597439:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.600542:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774336:192.168.202.133@tcp:49:rm.0 00000080:00200000:1.0:1767317536.600610:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61a.sanity-flr, dir=[0x240000404:0xf:0x0](ffff8c3c485163c8), flags=0 00000080:00200000:1.0:1767317536.600618:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61a.sanity-flr, dir=[0x240000404:0xf:0x0](ffff8c3c485163c8), intent=getattr 00000002:00010000:1.0:1767317536.600654:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000404:0xf:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.600745:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.600756:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.600766:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.600791:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774464:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.601260:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.607448:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774464:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.607493:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607535:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607544:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607560:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607573:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607612:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607621:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.607629:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.607640:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3480 x1853164291774464/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1136 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.607653:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.607668:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.607693:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/16 (0 0) 00000080:00200000:0.0:1767317536.607702:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000404:0xf:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.607756:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x10:0x0](ffff8c3c485100c8) 00000080:00200000:0.0:1767317536.607866:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x10:0x0], updating i_size 5 00000080:00200000:0.0:1767317536.607944:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x10:0x0]: layout version change: 4294967294 -> 8 00000080:00010000:0.0:1767317536.607953:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x10:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d77e 00000080:00010000:0.0:1767317536.607967:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x10:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317536.607971:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d77e from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317536.607975:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.607997:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.608041:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.608058:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61a.sanity-flr, dir=[0x240000404:0xf:0x0](ffff8c3c485163c8) 00010000:00010000:0.0:1767317536.608101:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.608211:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.608224:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x10:0x0]: losing layout lock 00010000:00010000:0.0:1767317536.608271:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 1/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.608278:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.608284:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.608287:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d77e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a736b7 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.608308:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0600/0x73c3d5cb1442d769 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73678 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.608327:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.608336:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efca80 x1853164291774720/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.608377:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774720:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.608507:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00010000:00010000:1.0:1767317536.615665:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.615732:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efca80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774720:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.615815:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317536.615831:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x10:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317536.615834:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317536.615841:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767317536.615855:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1767317536.615899:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317536.615910:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x10:0x0](ffff8c3c485100c8) 00000080:00200008:0.0:1767317536.616033:0:83367:0:(file.c:424:ll_file_release()) START file d61a.sanity-flr:[0x240000404:0xf:0x0](ffff8c3c485163c8), flags 704000 00010000:00010000:0.0:1767317536.616066:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.616120:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.616142:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.616151:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.616157:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.616162:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.616167:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.616171:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d75b 00000080:00010000:0.0:1767317536.616193:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d75b from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317536.616198:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.616227:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.616242:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.616262:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:0.0:1767317536.616267:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317536.616284:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.616341:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.616347:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.616355:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.616376:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774848:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.616478:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a1783c0 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.620113:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774848:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.620148:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620275:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620286:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620331:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620344:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620357:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620365:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620373:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.620386:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efea00 x1853164291774848/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.620401:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620415:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620429:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620438:0:83367:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620456:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620463:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.620490:0:83367:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:0.0:1767317536.620514:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0xf:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.620575:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.620583:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.620591:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.620616:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774976:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317536.620713:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767317536.620722:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.620740:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd800 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:2.0:1767317536.620746:0:63276:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.620755:0:63276:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.620764:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.620860:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00010000:00010000:2.0:1767317536.623550:0:63276:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.623621:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.623628:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767317536.623670:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.623679:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d785 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a736ef expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.623701:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317536.623703:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317536.623706:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317536.623742:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291775104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317536.627067:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291775104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.627459:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291774976:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.627486:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 4/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627501:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 4/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627515:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627543:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627559:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627569:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 5/2,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627576:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.627589:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42eff480 x1853164291774976/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.627604:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627622:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/15 (0 0) 00000080:00200000:0.0:1767317536.627643:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.627760:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0xf:0x0], updating i_size 4096 00000080:00200000:0.0:1767317536.627765:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x240000404:0xf:0x0](ffff8c3c485163c8): rc = 0 00000080:00010000:0.0:1767317536.627775:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for remote lock 0x73c3d5cb1442d78c 00000080:00010000:0.0:1767317536.627781:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d762 00000080:00010000:0.0:1767317536.627794:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.627797:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d762 from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317536.627802:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.627823:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767317536.627990:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d78c from it ffffa7f7c1c1fe00 00010000:00010000:0.0:1767317536.627995:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628003:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.628033:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.628059:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.628073:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628085:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.628092:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.628098:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.628101:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d75b 00000080:00010000:0.0:1767317536.628105:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d75b from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317536.628108:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628114:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.628135:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.628145:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317536.628260:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628318:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 1/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628325:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317536.628428:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291775232:192.168.202.133@tcp:103:rm.0 00010000:00010000:0.0:1767317536.628799:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1000/0x73c3d5cb1442d762 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7366a expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628848:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.628906:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.628964:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2300 x1853164291774208/t4294976349(4294976349) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317536.628979:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317536.628985:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efea00 x1853164291775488/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317536.629006:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291775488:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317536.629110:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.633246:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291775232:192.168.202.133@tcp:103:rm.0 00000100:00100000:0.0:1767317536.635859:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291775488:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317536.635971:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2300 x1853164291774208/t4294976349(4294976349) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317536.636089:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 1/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.636101:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 1/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.636107:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.636111:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d78c lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a736fd expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.636128:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d777 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73694 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.636156:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.636163:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efea00 x1853164291775744/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.636213:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291775744:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.637007:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:3.0:1767317536.640796:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317536.641044:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379236992 00000100:00100000:2.0:1767317536.641058:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379236992 00000100:00100000:2.0:1767317536.641134:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9527 00000100:00100000:2.0:1767317536.641145:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379236992:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317536.641288:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.641442:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317536.641450:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379236992:12345-192.168.202.133@tcp:104: Request processed in 307us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317536.641459:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9527 00010000:00010000:0.0:1767317536.641517:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317536.641526:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641536:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.641543:0:63490:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641577:0:63490:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641586:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641658:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641665:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317536.641707:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641715:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1600/0x73c3d5cb1442d75b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a7364e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.641740:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.641742:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.641744:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317536.641922:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291775872:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.647425:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291775872:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.658228:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efea00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291775744:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.658290:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0xf:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317536.658414:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.658452:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.658557:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.658570:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.658605:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.658640:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776000:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.658769:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.664313:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776000:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.664363:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664380:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664397:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664412:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664428:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664438:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664446:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.664460:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42eff800 x1853164291776000/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.664504:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664524:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317536.664532:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.664576:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.664584:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d793 00000080:00010000:0.0:1767317536.664590:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.664594:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d793 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317536.664597:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.664606:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.664645:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.664772:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317536.664779:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317536.664811:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.665040:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.665049:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.665060:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.665086:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776128:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.665419:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.669413:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776128:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.669453:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669485:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669495:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669510:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669524:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669539:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669547:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669555:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.669567:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42eff800 x1853164291776128/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.669581:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669612:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/75 (0 0) 00000080:00200000:0.0:1767317536.669620:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.669662:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317536.669688:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4b:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.669697:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d79a 00000080:00010000:0.0:1767317536.669716:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.669721:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d79a from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317536.669724:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.669734:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317536.669804:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.669813:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8),name=d61b.sanity-flr 00000002:00010000:0.0:1767317536.670158:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.670279:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.670296:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.670303:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.670311:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.670315:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d79a 00000080:00010000:0.0:1767317536.670320:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d79a from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317536.670324:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.670341:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.670424:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.670436:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.670444:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.670452:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.670459:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.670462:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.670466:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d793 00000080:00010000:0.0:1767317536.670470:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d793 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.670473:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.670481:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.670490:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.670499:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61b.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.670507:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8), inode mode 41ed mask 44 00000100:00100000:0.0:1767317536.670575:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776256:192.168.202.133@tcp:49:rm.0 00000100:00100000:0.0:1767317536.670932:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.673656:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776256:192.168.202.133@tcp:49:rm.0 00000080:00200008:0.0:1767317536.673736:0:83367:0:(file.c:1001:ll_file_open()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), flags 704400 00000002:00010000:0.0:1767317536.673777:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317536.673893:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.673904:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.673918:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.673927:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42eff800 x1853164291776512/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.673938:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.673962:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776512:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.674901:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.679054:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776512:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.679087:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679103:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679110:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679117:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679125:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679151:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.679156:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679163:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679240:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679250:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317536.679259:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.679266:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317536.679290:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42eff800 x1853164291776512/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.679306:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42eff800 x1853164291776512/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.679322:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.679350:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4b:0x0], updating i_size 4096 00000002:00100000:0.0:1767317536.679376:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42eff800 x1853164291776512/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.679465:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.679473:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8),name=d61b.sanity-flr 00000002:00010000:0.0:1767317536.679501:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.679527:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.679540:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.679548:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.679556:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.679560:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d79a 00000080:00010000:0.0:1767317536.679566:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d79a from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.679570:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.679578:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.679620:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767317536.679634:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000405:0x4b:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.679640:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.679648:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.680625:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776640:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317536.680840:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.690016:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776640:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317536.691064:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.691103:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317536.691207:0:83367:0:(file.c:424:ll_file_release()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), flags 704000 00000002:00100000:0.0:1767317536.691303:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42eff800 x1853164291776512/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317536.691318:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317536.691325:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efce00 x1853164291776896/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317536.691356:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776896:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317536.691488:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.694347:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291776896:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317536.694396:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42eff800 x1853164291776512/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.694511:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.694536:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.694559:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.694575:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.694585:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.694591:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.694595:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d793 00000080:00010000:0.0:1767317536.694620:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d793 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.694624:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.694634:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.694651:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.694659:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61b.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.694667:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8), inode mode 41ed mask 44 00000100:00100000:0.0:1767317536.694814:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777024:192.168.202.133@tcp:49:rm.0 00000100:00100000:0.0:1767317536.695151:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.707522:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777024:192.168.202.133@tcp:49:rm.0 00000080:00200008:0.0:1767317536.707580:0:83367:0:(file.c:1001:ll_file_open()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), flags 704400 00000002:00010000:0.0:1767317536.707623:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767317536.707809:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.707821:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.707835:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.708038:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efce00 x1853164291777280/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.708051:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.708080:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777280:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.708433:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.711552:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777280:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.711596:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.711609:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.711623:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.711636:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.711654:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c42efce00 x1853164291777280/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.711678:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efce00 x1853164291777280/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.711691:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.711703:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/75 (0 0) 00000080:00200000:0.0:1767317536.711711:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.711736:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4b:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.711742:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d7a8 00000080:00010000:0.0:1767317536.711750:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7a8 from it ffffa7f7c1c1fbd0 00010000:00010000:0.0:1767317536.711756:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.711783:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.711819:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efce00 x1853164291777280/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.712098:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.712107:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8),name=d61b.sanity-flr 00000002:00010000:0.0:1767317536.712136:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.712148:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.712160:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.712168:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.712174:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317536.712178:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d79a 00000080:00010000:0.0:1767317536.712193:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d79a from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.712196:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.712204:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.712247:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767317536.712276:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767317536.712304:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8), inode mode 41ed mask 1 00000100:00100000:0.0:1767317536.712374:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777408:192.168.202.133@tcp:49:rm.0 00000100:00100000:0.0:1767317536.712549:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.716062:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777408:192.168.202.133@tcp:49:rm.0 00000080:00200000:0.0:1767317536.716137:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x4b:0x0](ffff8c3c485163c8), flags=0 00000080:00200000:0.0:1767317536.716145:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x4b:0x0](ffff8c3c485163c8), intent=getattr 00000002:00010000:0.0:1767317536.716358:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x4b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.716438:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.716449:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.716461:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.716486:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777536:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.716652:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.720359:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777536:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.720395:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720425:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720434:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720449:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720483:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720498:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720507:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.720515:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.720527:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42eff800 x1853164291777536/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.720541:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.720559:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.720572:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/76 (0 0) 00000080:00200000:0.0:1767317536.720581:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x4b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.720635:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x4c:0x0](ffff8c3c485100c8) 00000080:00200000:0.0:1767317536.721091:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4c:0x0], updating i_size 5 00000080:00200000:0.0:1767317536.721120:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x4c:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317536.721127:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4c:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d7af 00000080:00010000:0.0:1767317536.721141:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4c:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317536.721152:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7af from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317536.721157:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.721167:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.721391:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.721407:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x4b:0x0](ffff8c3c485163c8) 00010000:00010000:0.0:1767317536.721452:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.721476:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.721568:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.721579:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x4c:0x0]: losing layout lock 00010000:00010000:0.0:1767317536.721616:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.721623:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.721628:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.721631:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d7af lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73797 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.721647:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d79a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73758 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.722398:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.722419:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42eff800 x1853164291777792/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.722541:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777792:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.722814:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.728824:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777792:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.728939:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x4c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317536.728953:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x4c:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317536.728957:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317536.728965:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767317536.729001:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x4c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317536.729033:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x4c:0x0](ffff8c3c485100c8) 00000080:00200008:1.0:1767317536.729152:0:83367:0:(file.c:424:ll_file_release()) START file d61b.sanity-flr:[0x200000405:0x4b:0x0](ffff8c3c485163c8), flags 704000 00010000:00010000:1.0:1767317536.729501:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.729569:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.729595:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.729607:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.729616:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.729623:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.729630:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.729634:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d793 00000080:00010000:1.0:1767317536.729642:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d793 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317536.729646:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.729655:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.729766:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.729791:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:1.0:1767317536.729797:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.729816:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.731272:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.731315:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.731333:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.731369:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777920:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.731498:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.735423:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291777920:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.735460:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735480:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735487:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735502:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735516:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735531:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735540:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735581:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.735595:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1880 x1853164291777920/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.735610:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735622:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/75 (0 0) 00000080:00200000:1.0:1767317536.735631:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.735660:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4b:0x0], updating i_size 4096 00000080:00200000:1.0:1767317536.735663:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x4b:0x0](ffff8c3c485163c8): rc = 0 00000080:00010000:1.0:1767317536.735683:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d7b6 00000080:00010000:1.0:1767317536.735697:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00010000:1.0:1767317536.735701:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7b6 from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317536.735704:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735713:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.735759:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.735784:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.735795:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.735806:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.735821:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.735826:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.735831:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d793 00000080:00010000:1.0:1767317536.735835:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d793 from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317536.735839:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.736452:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.736466:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.736477:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317536.736509:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.736544:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.736558:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.736618:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efce00 x1853164291777280/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.736633:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.736639:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291778176/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.736755:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778176:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.740684:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.740751:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778176:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.740792:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efce00 x1853164291777280/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317536.740922:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.740934:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.740942:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.740948:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317536.740952:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7b6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a737cf expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.740965:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d7a8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x4b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73774 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.740979:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d793 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7373c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.740999:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.741005:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1880 x1853164291778432/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.741029:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778432:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.741113:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.744910:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778432:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.744976:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x4b:0x0](ffff8c3c485163c8) 00000080:00200000:1.0:1767317536.745092:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.745121:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.745205:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.745216:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.745228:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.745258:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778560:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.745375:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.750072:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778560:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.750106:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750121:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750135:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750147:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750164:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750295:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750304:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.750318:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291778560/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.750334:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750349:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317536.750357:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.750395:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.750404:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7bd 00000080:00010000:1.0:1767317536.750411:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.750415:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7bd from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317536.750418:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.750428:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.750464:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.750497:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317536.750503:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.750537:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.750601:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.750609:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.750619:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.750645:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778688:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.750974:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.754624:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778688:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.754662:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754704:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754713:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754726:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754740:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754754:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754763:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754791:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.754805:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291778688/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.754822:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.754837:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/22 (0 0) 00000002:00010000:1.0:1767317536.754908:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x16:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.754996:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.755005:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.755017:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.755052:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778816:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.755160:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.758414:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778816:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.758450:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 4/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758466:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758509:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758521:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758536:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758544:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758553:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.758566:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2300 x1853164291778816/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.758582:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758599:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/22 (0 0) 00000080:00200000:1.0:1767317536.758623:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.758670:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.758680:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x16:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.758688:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for remote lock 0x73c3d5cb1442d7cb 00000080:00010000:1.0:1767317536.758694:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7c4 00000080:00010000:1.0:1767317536.758708:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.758719:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7c4 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.758724:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758734:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317536.758751:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d7cb from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.758756:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758765:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.758801:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.758809:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8),name=d61c.sanity-flr 00000002:00010000:1.0:1767317536.758851:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.758862:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758920:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.758929:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.758935:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.758939:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7cb 00000080:00010000:1.0:1767317536.758943:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7cb from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317536.758946:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.758965:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.759041:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.759052:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.759062:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.759070:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.759077:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.759081:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.759084:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7bd 00000080:00010000:1.0:1767317536.759088:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7bd from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.759091:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.759099:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.759107:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.759116:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61c.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.759124:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000100:00100000:1.0:1767317536.759523:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778944:192.168.202.133@tcp:49:rm.0 00000100:00100000:1.0:1767317536.759626:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.762540:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291778944:192.168.202.133@tcp:49:rm.0 00000080:00200008:1.0:1767317536.762619:0:83367:0:(file.c:1001:ll_file_open()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.762659:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317536.762762:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.762773:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.762788:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.762798:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291779200/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.762809:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.762834:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779200:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.763112:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.766707:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779200:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.766741:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766758:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766767:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766776:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766786:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766816:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317536.766821:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766828:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766837:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766850:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317536.766859:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.766867:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317536.767070:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c2300 x1853164291779200/t4294976353(4294976353) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.767084:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291779200/t4294976353(4294976353) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.767098:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.767125:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x16:0x0], updating i_size 4096 00000002:00100000:1.0:1767317536.767150:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2300 x1853164291779200/t4294976353(4294976353) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.767256:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.767266:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8),name=d61c.sanity-flr 00000002:00010000:1.0:1767317536.767295:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.767319:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.767333:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.767342:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.767350:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.767354:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7cb 00000080:00010000:1.0:1767317536.767361:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7cb from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.767366:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.767375:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.767423:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767317536.767440:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x240000404:0x16:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317536.767446:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.767455:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317536.769015:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779328:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317536.769165:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.776604:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779328:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317536.779603:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.779651:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.779756:0:83367:0:(file.c:424:ll_file_release()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), flags 704000 00000002:00100000:1.0:1767317536.780197:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2300 x1853164291779200/t4294976353(4294976353) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.780213:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.780219:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2680 x1853164291779584/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.780253:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779584:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.780387:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.783377:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779584:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.783423:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2300 x1853164291779200/t4294976353(4294976353) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.783532:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.783554:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.783576:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.783592:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.783600:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.783606:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.783611:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7bd 00000080:00010000:1.0:1767317536.783635:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7bd from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.783639:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.783650:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.783667:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.783758:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61c.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.783766:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000100:00100000:1.0:1767317536.783826:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779712:192.168.202.133@tcp:49:rm.0 00000100:00100000:1.0:1767317536.784161:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.787016:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779712:192.168.202.133@tcp:49:rm.0 00000080:00200008:1.0:1767317536.787081:0:83367:0:(file.c:1001:ll_file_open()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.787128:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317536.787226:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.787238:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.787252:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.787261:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2680 x1853164291779968/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.787272:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.787295:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779968:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.787587:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.791627:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291779968:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.791682:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.791694:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.791707:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.791721:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.791738:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c2680 x1853164291779968/t4294976355(4294976355) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.791753:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2680 x1853164291779968/t4294976355(4294976355) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.791766:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.792093:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/22 (0 0) 00000080:00200000:1.0:1767317536.792102:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.792128:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x16:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.792134:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7d9 00000080:00010000:1.0:1767317536.792145:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7d9 from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317536.792149:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.792258:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.792301:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2680 x1853164291779968/t4294976355(4294976355) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.792402:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.792410:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8),name=d61c.sanity-flr 00000002:00010000:1.0:1767317536.792438:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x16:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.792451:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.792464:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.792471:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.792477:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.792480:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7cb 00000080:00010000:1.0:1767317536.792484:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7cb from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.792487:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.792494:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.792536:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767317536.792565:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767317536.792594:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8), inode mode 41ed mask 1 00000100:00100000:1.0:1767317536.792662:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780096:192.168.202.133@tcp:49:rm.0 00000100:00100000:1.0:1767317536.793098:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.795648:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780096:192.168.202.133@tcp:49:rm.0 00000080:00200000:1.0:1767317536.795727:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61c.sanity-flr, dir=[0x240000404:0x16:0x0](ffff8c3c485e21c8), flags=0 00000080:00200000:1.0:1767317536.795735:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61c.sanity-flr, dir=[0x240000404:0x16:0x0](ffff8c3c485e21c8), intent=getattr 00000002:00010000:1.0:1767317536.795769:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000404:0x16:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.795855:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.795867:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.796157:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.796255:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780224:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.796409:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.799584:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780224:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.799615:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799641:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799651:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799665:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799704:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799719:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799728:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.799736:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.799747:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2300 x1853164291780224/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.799760:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317536.799774:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.799786:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/23 (0 0) 00000080:00200000:1.0:1767317536.799795:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000404:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.799848:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x17:0x0](ffff8c3c485e5348) 00000080:00200000:1.0:1767317536.800194:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x17:0x0], updating i_size 7 00000080:00200000:1.0:1767317536.800222:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x17:0x0]: layout version change: 4294967294 -> 7 00000080:00010000:1.0:1767317536.800230:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x17:0x0](ffff8c3c485e5348) for lock 0x73c3d5cb1442d7e0 00000080:00010000:1.0:1767317536.800243:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x17:0x0](ffff8c3c485e5348) 00000080:00010000:1.0:1767317536.800253:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7e0 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317536.800258:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.800268:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317536.800307:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.800321:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61c.sanity-flr, dir=[0x240000404:0x16:0x0](ffff8c3c485e21c8) 00010000:00010000:1.0:1767317536.800364:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.800469:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317536.800482:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x17:0x0]: losing layout lock 00010000:00010000:1.0:1767317536.800518:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.800526:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 1/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.800532:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317536.800535:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d7e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7385b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317536.800551:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7381c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.800568:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.800576:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2300 x1853164291780480/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.800611:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780480:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.800732:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.805789:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780480:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.806034:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x17:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317536.806053:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x17:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317536.806057:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317536.806068:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767317536.806108:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x17:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317536.806119:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x17:0x0](ffff8c3c485e5348) 00000080:00200008:1.0:1767317536.806385:0:83367:0:(file.c:424:ll_file_release()) START file d61c.sanity-flr:[0x240000404:0x16:0x0](ffff8c3c485e21c8), flags 704000 00010000:00010000:1.0:1767317536.806428:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.806491:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.806511:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.806521:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.806532:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.806540:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.806547:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.806552:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7bd 00000080:00010000:1.0:1767317536.806561:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7bd from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317536.806566:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.806593:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.806609:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.806624:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:1.0:1767317536.806628:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.806643:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.806770:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.806779:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.806791:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.806822:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780608:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.807260:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.809422:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780608:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.809453:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809469:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809475:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809506:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809516:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809526:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809532:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809537:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.809546:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3480 x1853164291780608/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.809557:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809565:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809576:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809581:0:83367:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809592:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809596:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.809658:0:83367:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:1.0:1767317536.809682:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x16:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.809727:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.809732:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.809738:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.809755:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780736:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.809851:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00010000:00010000:0.0:1767317536.811828:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317536.811853:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811866:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.811880:0:60279:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811890:0:60279:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811900:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811932:0:60279:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811986:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.811991:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317536.812017:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.812022:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0000/0x73c3d5cb1442d7e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73893 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.812051:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.812052:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317536.812054:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.812072:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291780864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317536.814414:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291780864:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.814509:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291780736:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.814529:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 4/1,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814542:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 4/1,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814554:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814587:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814599:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814604:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814609:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.814616:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291780736/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.814627:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814638:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/22 (0 0) 00000080:00200000:1.0:1767317536.814652:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.814686:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x16:0x0], updating i_size 4096 00000080:00200000:1.0:1767317536.814689:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x240000404:0x16:0x0](ffff8c3c485e21c8): rc = 0 00000080:00010000:1.0:1767317536.814696:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for remote lock 0x73c3d5cb1442d7ee 00000080:00010000:1.0:1767317536.814700:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7c4 00000080:00010000:1.0:1767317536.814711:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.814714:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7c4 from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317536.814718:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814732:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317536.814746:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d7ee from it ffffa7f7c1c1fe00 00010000:00010000:1.0:1767317536.814749:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814753:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.814773:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.814796:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.814807:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814820:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.814826:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.814831:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.814835:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7bd 00000080:00010000:1.0:1767317536.814850:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7bd from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317536.814854:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814861:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.814910:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317536.814921:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317536.814946:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.814995:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.815000:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317536.815022:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d7c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7380e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.815046:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.815057:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.815086:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2680 x1853164291779968/t4294976355(4294976355) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.815096:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.815099:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3480 x1853164291781248/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.815116:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781248:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.815212:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.815292:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291780992:192.168.202.133@tcp:103:rm.0 00000100:00100000:0.0:1767317536.818090:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291780992:192.168.202.133@tcp:103:rm.0 00000100:00100000:1.0:1767317536.818192:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781248:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.818256:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2680 x1853164291779968/t4294976355(4294976355) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317536.818342:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 1/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.818351:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.818354:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317536.818357:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d7ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738a1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.818365:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x16:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73838 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317536.818391:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317536.818398:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3480 x1853164291781504/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317536.818425:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781504:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317536.818499:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317536.821032:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317536.821094:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379238400 00000100:00100000:3.0:1767317536.821110:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379238400 00000100:00100000:2.0:1767317536.821326:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9528 00000100:00100000:2.0:1767317536.821339:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379238400:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317536.821363:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.821522:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317536.821529:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379238400:12345-192.168.202.133@tcp:104: Request processed in 193us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317536.821535:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9528 00010000:00010000:1.0:1767317536.821970:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317536.821980:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.821990:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1a00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317536.821995:0:64002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822023:0:64002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822033:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822112:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822119:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767317536.822214:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291781632:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317536.822795:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822808:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a737f2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.822835:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317536.824130:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317536.824140:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317536.827570:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291781632:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317536.832243:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781504:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317536.832304:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x16:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.832407:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.832438:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.832519:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.832530:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.832563:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.832590:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781760:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.832727:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.838552:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781760:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.838585:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838596:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838606:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838614:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838625:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838630:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838635:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.838643:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291781760/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.838683:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838696:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317536.838703:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.838734:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.838739:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7f5 00000080:00010000:1.0:1767317536.838743:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.838746:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7f5 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317536.838748:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.838754:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.838783:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.838807:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317536.838812:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317536.838850:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.838939:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.838947:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.838958:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.838982:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781888:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.839085:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.842788:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291781888:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.842820:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.842959:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.842970:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.842983:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.842996:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843012:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843021:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843030:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.843041:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291781888/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.843053:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843081:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/80 (0 0) 00000080:00200000:1.0:1767317536.843089:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317536.843136:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00200000:1.0:1767317536.843143:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x50:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.843150:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7fc 00000080:00010000:1.0:1767317536.843164:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.843167:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7fc from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317536.843311:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843322:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.843373:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.843381:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8),name=d62.sanity-flr 00000002:00010000:1.0:1767317536.843418:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.843428:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843440:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.843448:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.843452:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.843455:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7fc 00000080:00010000:1.0:1767317536.843458:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7fc from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317536.843460:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843471:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.843529:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.843536:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.843541:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843547:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.843551:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.843553:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.843554:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7f5 00000080:00010000:1.0:1767317536.843556:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7f5 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.843558:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.843563:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.843567:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.843573:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d62.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.843577:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.843586:0:83367:0:(file.c:1001:ll_file_open()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.843598:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317536.843649:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.843661:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.843750:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.843757:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0e00 x1853164291782144/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.843765:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.843792:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782144:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.844205:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.847367:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782144:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.847397:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847413:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847420:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847428:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847437:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847444:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0c00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317536.847450:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847478:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847487:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847495:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317536.847504:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.847511:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317536.847536:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c0e00 x1853164291782144/t8589937439(8589937439) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.847551:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0e00 x1853164291782144/t8589937439(8589937439) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.847566:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.847599:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x50:0x0], updating i_size 4096 00000002:00100000:1.0:1767317536.847627:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0e00 x1853164291782144/t8589937439(8589937439) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.847741:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.847750:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8),name=d62.sanity-flr 00000002:00010000:1.0:1767317536.847781:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.847800:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.847814:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.847828:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.847835:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.848423:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7fc 00000080:00010000:1.0:1767317536.848437:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7fc from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.848442:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.848453:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.848501:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767317536.848521:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000405:0x50:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317536.848530:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.848540:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317536.849278:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782272:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317536.849422:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.859470:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782272:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317536.860273:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.860292:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317536.860401:0:83367:0:(file.c:424:ll_file_release()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), flags 704000 00000002:00100000:1.0:1767317536.860490:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0e00 x1853164291782144/t8589937439(8589937439) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317536.860504:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317536.860510:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291782528/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317536.860539:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782528:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317536.860662:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317536.873520:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782528:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317536.873576:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0e00 x1853164291782144/t8589937439(8589937439) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317536.873695:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317536.873722:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.873748:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.873766:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.873776:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.873783:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317536.873787:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7f5 00000080:00010000:1.0:1767317536.873797:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7f5 from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317536.873801:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.873829:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.874193:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.874204:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d62.sanity-flr, flags=266 00000080:00200000:1.0:1767317536.874248:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317536.874260:0:83367:0:(file.c:1001:ll_file_open()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), flags 704400 00000002:00010000:1.0:1767317536.874282:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317536.874371:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317536.874380:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317536.874395:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317536.874404:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291782784/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317536.874416:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317536.874443:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782784:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317536.874712:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317536.881255:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782784:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317536.881301:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881314:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881347:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881360:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.881379:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c0000 x1853164291782784/t8589937441(8589937441) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317536.881394:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0000 x1853164291782784/t8589937441(8589937441) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317536.881408:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881420:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/80 (0 0) 00000080:00200000:1.0:1767317536.881427:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317536.881452:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x50:0x0], updating i_size 4096 00000080:00010000:1.0:1767317536.881458:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d80a 00000080:00010000:1.0:1767317536.881467:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d80a from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317536.881472:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881483:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317536.881514:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0000 x1853164291782784/t8589937441(8589937441) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317536.881609:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317536.881618:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8),name=d62.sanity-flr 00000002:00010000:1.0:1767317536.881645:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x50:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317536.881656:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881670:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.881677:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317536.881683:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00010000:1.0:1767317536.881687:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d7fc 00000080:00010000:1.0:1767317536.881691:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7fc from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317536.881694:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317536.881702:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317536.881739:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767317536.881764:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767317536.881791:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317536.881809:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x50:0x0](ffff8c3c485e21c8), flags=0 00000080:00200000:1.0:1767317536.881826:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x50:0x0](ffff8c3c485e21c8), intent=getattr 00000002:00010000:1.0:1767317536.881846:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x50:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.882512:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.882524:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.882534:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.882588:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782912:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.882711:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.892507:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291782912:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.892542:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892575:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892584:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892597:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892609:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892642:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892651:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.892659:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.892682:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291782912/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.892695:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.892710:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.892722:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/83 (0 0) 00000080:00200000:0.0:1767317536.892731:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x50:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.894613:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x53:0x0](ffff8c3c485121c8) 00000080:00200000:0.0:1767317536.894739:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x53:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317536.894749:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d811 00000080:00010000:0.0:1767317536.895342:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317536.895348:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d811 from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317536.895357:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.895408:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.895454:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317536.895465:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x50:0x0](ffff8c3c485e21c8) 00010000:00010000:0.0:1767317536.895512:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.895535:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.895605:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317536.895616:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x53:0x0]: losing layout lock 00010000:00010000:0.0:1767317536.895658:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.895677:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 1/0,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.895684:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317536.895688:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d811 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7393b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317536.895707:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0a00/0x73c3d5cb1442d7fc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738fc expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.895725:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.895744:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efc000 x1853164291783168/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.895781:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efc000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783168:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.895962:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.907338:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efc000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783168:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317536.907421:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x53:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317536.907436:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x53:0x0]: flr state: 2, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317536.907440:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317536.907449:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x16 00000080:00200000:0.0:1767317536.907485:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x53:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317536.907495:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x53:0x0](ffff8c3c485121c8) 00000080:00200008:0.0:1767317536.907609:0:83367:0:(file.c:424:ll_file_release()) START file d62.sanity-flr:[0x200000405:0x50:0x0](ffff8c3c485e21c8), flags 704000 00010000:00010000:0.0:1767317536.907645:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.907706:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.907728:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.907740:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.907750:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.907758:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.907764:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.907769:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7f5 00000080:00010000:0.0:1767317536.907778:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7f5 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317536.907803:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.907986:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.908008:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.908029:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=0 00000080:00200000:0.0:1767317536.908034:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317536.908052:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.908111:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.908119:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.908130:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.908155:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783296:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.908341:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.913758:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783296:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.913795:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914823:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914843:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914913:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914929:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914948:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914957:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.914965:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.914985:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291783296/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.914999:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.915012:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/80 (0 0) 00000080:00200000:0.0:1767317536.915019:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317536.915629:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x50:0x0], updating i_size 4096 00000080:00200000:2.0:1767317536.915637:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x50:0x0](ffff8c3c485e21c8): rc = 0 00000080:00010000:2.0:1767317536.915647:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) for lock 0x73c3d5cb1442d818 00000080:00010000:2.0:1767317536.915664:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00010000:2.0:1767317536.915668:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d818 from it ffffa7f7c1c1fe00 00010000:00010000:2.0:1767317536.915673:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.915684:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317536.915736:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317536.915767:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.915779:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.915792:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317536.915799:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317536.915805:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317536.915808:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d7f5 00000080:00010000:2.0:1767317536.915812:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d7f5 from it ffffa7f7c1c1fd88 00010000:00010000:2.0:1767317536.915816:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.915840:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317536.915851:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317536.915862:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317536.915995:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.916028:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317536.916040:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317536.916102:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0000 x1853164291782784/t8589937441(8589937441) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767317536.916116:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767317536.916122:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3a300 x1853164291783552/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767317536.916152:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783552:192.168.202.133@tcp:35:rm.0 00000100:00100000:2.0:1767317536.916512:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.921322:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783552:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317536.921542:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0000 x1853164291782784/t8589937441(8589937441) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767317536.921652:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.921684:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.921691:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.921697:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767317536.921700:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d818 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73973 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.921715:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0c00/0x73c3d5cb1442d80a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x50:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73918 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.921728:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1a00/0x73c3d5cb1442d7f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a738e0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317536.921750:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317536.921757:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efe300 x1853164291783808/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317536.921784:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efe300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783808:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317536.922021:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.930311:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efe300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783808:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317536.930562:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x50:0x0](ffff8c3c485e21c8) 00000080:00200000:2.0:1767317536.930671:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317536.930703:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317536.934378:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.934429:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317536.934444:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317536.934475:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783936:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317536.934669:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.943422:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291783936:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.943463:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943499:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943514:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943527:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943541:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943550:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.943558:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.943570:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291783936/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.943586:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.944102:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317536.944115:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.944154:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317536.944162:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d81f 00000080:00010000:0.0:1767317536.944169:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.944194:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d81f from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317536.944199:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.944210:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.944246:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.944279:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317536.944284:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317536.944677:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d70a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.944749:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.944759:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.944771:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.944806:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784064:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.945197:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.952654:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784064:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.952745:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952777:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952786:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952827:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952931:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952948:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952957:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.952964:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.953047:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efdc00 x1853164291784064/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.953063:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.953073:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/86 (0 0) 00000080:00200000:0.0:1767317536.953079:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317536.953126:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8) 00000002:00010000:0.0:1767317536.953156:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.953233:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.953241:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.953260:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.953287:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784192:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.953448:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.957225:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784192:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.957335:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.957575:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958121:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958138:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958152:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958160:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958168:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.958192:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291784192/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.958309:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958324:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/6 (0 0) 00010000:00010000:0.0:1767317536.958331:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.958337:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.958577:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.958636:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.958642:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.958649:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.958742:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784320:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.959092:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.962285:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784320:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.962316:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962330:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962369:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962382:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962396:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962405:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962411:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317536.962424:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291784320/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317536.962440:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962455:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/6 (0 0) 00010000:00010000:0.0:1767317536.962464:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962472:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.962521:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x56:0x0], updating i_size 8192 00000080:00010000:0.0:1767317536.962544:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d826 00000080:00010000:0.0:1767317536.962560:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317536.962564:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d826 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317536.962568:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962576:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317536.962613:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.962621:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8),name=d70a.sanity-flr 00000002:00010000:0.0:1767317536.962654:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x56:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.962764:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.962779:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.963075:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.963084:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963093:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963100:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963107:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.963125:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.963131:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963138:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963145:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963151:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.963162:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317536.963549:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317536.963557:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d826 00000080:00010000:0.0:1767317536.963563:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d826 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317536.963567:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963576:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.963593:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.963600:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963609:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963624:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963631:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.963640:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.963645:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963653:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963660:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.963665:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.964460:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317536.964479:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.964491:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.964500:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.964507:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317536.964513:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317536.964526:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d81f 00000080:00010000:0.0:1767317536.964533:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d81f from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317536.964537:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.964544:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.964553:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317536.964561:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=266 00000080:00200000:0.0:1767317536.964569:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767317536.964579:0:83367:0:(file.c:1001:ll_file_open()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), flags 704400 00000002:00010000:0.0:1767317536.964598:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x56:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317536.964684:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.964692:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317536.964707:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317536.964720:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efdc00 x1853164291784576/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317536.964731:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317536.964760:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784576:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317536.965086:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317536.971403:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784576:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317536.971437:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971475:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971483:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971491:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971500:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971507:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317536.971512:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971520:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971528:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971536:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317536.971544:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317536.971551:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d83b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317536.971573:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efdc00 x1853164291784576/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317536.971587:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efdc00 x1853164291784576/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317536.971614:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317536.971654:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x56:0x0], updating i_size 4096 00000002:00100000:0.0:1767317536.972161:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efdc00 x1853164291784576/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317536.972267:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317536.972277:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8),name=d70a.sanity-flr 00000002:00010000:0.0:1767317536.972306:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x56:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.972325:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972339:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.972350:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.972357:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972366:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972375:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972383:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.972401:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.972409:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972424:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972432:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972438:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.972450:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317536.972456:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317536.972460:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d826 00000080:00010000:0.0:1767317536.972465:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d826 from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317536.972468:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972475:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.972485:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.972490:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972496:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972503:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972522:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.972529:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317536.972534:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972540:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972547:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972555:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317536.972587:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317536.972597:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.972619:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.972625:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.972632:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317536.973630:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784704:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317536.974682:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317536.992168:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784704:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317536.993303:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.993329:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317536.993365:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317536.993384:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317536.993400:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317536.995382:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784832:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317536.995612:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.011563:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291784832:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317537.013052:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.013078:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317537.013189:0:83367:0:(file.c:424:ll_file_release()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), flags 704000 00000002:00100000:1.0:1767317537.013467:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efdc00 x1853164291784576/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.013482:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.013489:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291785088/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.013521:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785088:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.014054:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.022733:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785088:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.022785:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efdc00 x1853164291784576/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317553 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.023267:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.023296:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.023318:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.023335:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.023362:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.023371:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.023375:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d81f 00000080:00010000:1.0:1767317537.023384:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d81f from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317537.023389:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.023399:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.023417:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.023426:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=266 00000080:00200000:1.0:1767317537.023435:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767317537.023445:0:83367:0:(file.c:1001:ll_file_open()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), flags 704400 00000002:00010000:1.0:1767317537.023463:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x56:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317537.023526:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.023534:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317537.023547:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317537.023556:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291785344/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317537.023566:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.023590:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785344:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.024354:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.029280:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785344:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.029327:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x56:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029339:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029356:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029370:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.029388:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c1180 x1853164291785344/t8589937447(8589937447) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317537.029402:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291785344/t8589937447(8589937447) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.029420:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029433:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 16 res 8589935621/86 (0 0) 00000080:00200000:1.0:1767317537.029441:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.029486:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x56:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.029495:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d842 00000080:00010000:1.0:1767317537.029504:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d842 from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317537.029509:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029539:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.029572:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c1180 x1853164291785344/t8589937447(8589937447) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317537.029668:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.029678:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8),name=d70a.sanity-flr 00000002:00010000:1.0:1767317537.029703:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x56:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.029715:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029727:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.029736:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.029742:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029749:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029756:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029762:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.029772:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.029786:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029794:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029801:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029807:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.029815:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317537.029822:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) 00000080:00010000:1.0:1767317537.029826:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x56:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d826 00000080:00010000:1.0:1767317537.029830:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d826 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317537.029833:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029840:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.029853:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.029859:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029866:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029931:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029944:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.029954:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.029959:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029967:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029974:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.029981:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.030039:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317537.030054:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.030080:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317537.030087:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.030094:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317537.030109:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317537.030113:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.030125:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.030137:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x6:0x0]) in obj [0x240000405:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317537.030142:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.030149:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767317537.030160:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767317537.030164:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.030171:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.030224:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767317537.030253:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.030271:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8), flags=0 00000080:00200000:1.0:1767317537.030275:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8), intent=getattr 00000002:00010000:1.0:1767317537.030294:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f70a.sanity-flr.fsxgood,[0x0:0x0:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.030354:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.030363:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.030382:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.030409:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785472:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.030519:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.035620:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785472:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.035659:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035703:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035712:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035728:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035741:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035755:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035773:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.035781:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.035819:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1f80 x1853164291785472/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.035834:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.035856:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.035868:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/407 (0 0) 00000080:00200000:1.0:1767317537.035910:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0x6:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317537.035955:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x197:0x0](ffff8c3c485e5348) 00000080:00200000:1.0:1767317537.036051:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x197:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1767317537.036059:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x197:0x0](ffff8c3c485e5348) for lock 0x73c3d5cb1442d849 00000080:00010000:1.0:1767317537.036073:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x197:0x0](ffff8c3c485e5348) 00000080:00010000:1.0:1767317537.036077:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d849 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317537.036081:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.036090:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.036130:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.036140:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8) 00010000:00010000:1.0:1767317537.036193:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.036633:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.036661:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x197:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.036717:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.036725:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.036732:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317537.036735:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d849 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73a0d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.036754:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d834 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739ce expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.037046:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.037059:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1f80 x1853164291785728/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.037092:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785728:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.037250:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.044627:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785728:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.044722:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x197:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.044741:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.044792:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x197:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.044803:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x197:0x0](ffff8c3c485e5348) 00000080:00200000:1.0:1767317537.044975:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.044998:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8), flags=0 00000080:00200000:1.0:1767317537.045023:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8), intent=getattr 00000002:00010000:1.0:1767317537.045055:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f70a.sanity-flr.fsxlog,[0x0:0x0:0x0]) in obj [0x240000405:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.045125:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.045137:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.045149:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.045174:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785856:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.045299:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.051857:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291785856:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.051938:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.051977:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.051986:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.051999:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.052013:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.052027:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.052053:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.052062:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.052074:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2d80 x1853164291785856/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.052087:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.052101:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.052113:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/408 (0 0) 00000080:00200000:1.0:1767317537.052121:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0x6:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317537.052166:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x198:0x0](ffff8c3c485e7448) 00000080:00200000:1.0:1767317537.052290:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x198:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1767317537.052298:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x198:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d850 00000080:00010000:1.0:1767317537.052312:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x198:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317537.052316:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d850 from it ffffa7f7c1c1fdf8 00010000:00010000:1.0:1767317537.052320:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.052329:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.052382:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.052392:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x56:0x0](ffff8c3c485121c8) 00010000:00010000:1.0:1767317537.052438:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.052455:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x198:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.052506:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.052513:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317537.052516:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d850 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73a45 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767317537.052546:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.052555:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2d80 x1853164291786112/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.052582:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786112:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.052712:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.060008:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2d80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786112:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.060093:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x198:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.060110:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.060143:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x198:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.060151:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x198:0x0](ffff8c3c485e7448) 00000080:00200008:1.0:1767317537.060278:0:83367:0:(file.c:424:ll_file_release()) START file d70a.sanity-flr:[0x200000405:0x56:0x0](ffff8c3c485121c8), flags 704000 00010000:00010000:1.0:1767317537.060311:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.060381:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.060405:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.060417:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.060427:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.060435:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.060443:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.060447:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d81f 00000080:00010000:1.0:1767317537.060454:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d81f from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.060458:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.060466:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.060483:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.060494:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.060501:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.060508:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.060514:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.060522:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.060538:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.060543:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.060546:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d81f 00000080:00010000:1.0:1767317537.060550:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d81f from it ffffa7f7c1c1fd88 00010000:00010000:1.0:1767317537.060553:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.060561:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.060569:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.060575:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.060601:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.060631:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.060685:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c1180 x1853164291785344/t8589937447(8589937447) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.060698:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.060703:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291786368/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.060728:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786368:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.060838:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.065155:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786368:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.065250:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c1180 x1853164291785344/t8589937447(8589937447) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767317537.065316:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065379:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065387:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065394:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065401:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317537.065405:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d842 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x56:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739ea expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065420:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d826 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a739b2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.065435:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0800/0x73c3d5cb1442d81f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73996 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.065457:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.065464:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0000 x1853164291786624/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.065490:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786624:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.065612:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.071117:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317537.071509:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379239936 00000100:00100000:3.0:1767317537.071524:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379239936 00000100:00100000:3.0:1767317537.071598:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9529 00000100:00100000:3.0:1767317537.071610:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379239936:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317537.071632:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.071728:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317537.071736:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379239936:12345-192.168.202.133@tcp:104: Request processed in 128us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317537.071744:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9529 00010000:00010000:1.0:1767317537.071832:0:63743:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317537.071851:0:63743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.071862:0:63743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd000 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317537.071909:0:63743:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.071921:0:63743:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.071930:0:63743:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.072058:0:63743:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.072066:0:63743:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317537.072090:0:63743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.072098:0:63743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d82d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a739c0 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.072118:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317537.072119:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317537.072121:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317537.072250:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291786752:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317537.087126:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291786752:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317537.096214:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786624:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.096306:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x56:0x0](ffff8c3c485121c8) 00000080:00200000:1.0:1767317537.096419:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.096446:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.096521:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.096532:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.096543:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.096574:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786880:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.096701:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.100630:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291786880:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.100668:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100684:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100698:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100711:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100725:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100757:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100774:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.100788:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291786880/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.100803:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100819:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.100828:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.100865:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.100925:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d857 00000080:00010000:1.0:1767317537.100932:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.100936:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d857 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317537.100939:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.100947:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.100979:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.101005:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317537.101010:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317537.101040:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.101102:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.101109:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.101119:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.101146:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787008:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.101285:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.107495:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787008:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.107534:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.108601:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.108620:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.108634:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.108647:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.108989:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.109000:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.109008:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.109027:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0e00 x1853164291787008/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/672 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.109046:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.109060:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/85 (0 0) 00000080:00200000:0.0:1767317537.109068:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.109132:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08) 00000002:00010000:0.0:1767317537.109166:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.109553:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.109562:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.109571:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.109598:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787136:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.109970:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.115844:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787136:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.115900:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115917:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115933:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115948:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115964:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115972:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.115981:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.115993:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291787136/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.116011:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.116028:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1767317537.116037:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.116071:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.116121:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.116938:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.116952:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.116963:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.116990:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787264:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.117112:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.121212:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787264:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.121464:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 4/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121479:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 4/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121494:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121507:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121520:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121549:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121557:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.121570:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291787264/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.121586:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121602:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677445/5 (0 0) 00010000:00010000:0.0:1767317537.121611:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.121619:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.121853:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x55:0x0], updating i_size 8192 00000080:00010000:0.0:1767317537.121984:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d85e 00000080:00010000:0.0:1767317537.122002:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) 00000080:00010000:0.0:1767317537.122006:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d85e from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317537.122011:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122021:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767317537.122080:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x55:0x0](ffff8c3c48514b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.122090:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08),name=d70.sanity-flr 00000002:00010000:0.0:1767317537.122128:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x55:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122140:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122153:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.122165:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122188:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122196:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122204:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122211:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.122222:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122447:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122458:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122477:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122486:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.122498:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317537.122504:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) 00000080:00010000:0.0:1767317537.122508:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d85e 00000080:00010000:0.0:1767317537.122512:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d85e from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317537.122515:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122522:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.122533:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122539:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122548:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122555:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122562:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.122581:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122587:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122595:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122602:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122608:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.122966:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.122979:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.122988:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.122997:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.123003:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.123008:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.123011:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d857 00000080:00010000:0.0:1767317537.123015:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d857 from it ffffa7f7c1c1fbf8 00010000:00010000:0.0:1767317537.123018:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.123039:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.123049:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.123058:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=266 00000080:00200000:0.0:1767317537.123067:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08), inode mode 41ed mask 44 00000080:00200008:0.0:1767317537.123079:0:83367:0:(file.c:1001:ll_file_open()) START file d70.sanity-flr:[0x200000405:0x55:0x0](ffff8c3c48514b08), flags 704400 00000002:00010000:0.0:1767317537.123100:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x55:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767317537.123165:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.123189:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:0.0:1767317537.123203:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767317537.123216:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd180 x1853164291787520/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767317537.123348:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.123457:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787520:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.124026:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.131038:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787520:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.131070:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131087:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131118:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131126:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131135:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131142:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317537.131148:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131156:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131163:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131190:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767317537.131198:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.131205:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:0.0:1767317537.131377:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c42efd180 x1853164291787520/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767317537.131393:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd180 x1853164291787520/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317537.131414:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.131465:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x55:0x0], updating i_size 4096 00000002:00100000:0.0:1767317537.131489:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c42efd180 x1853164291787520/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767317537.131582:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x55:0x0](ffff8c3c48514b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.131591:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08),name=d70.sanity-flr 00000002:00010000:0.0:1767317537.131616:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x55:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.131634:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131647:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.131657:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.131664:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131670:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131678:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131686:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.131702:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.131711:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131730:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131738:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.131745:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.131756:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767317537.131762:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) 00000080:00010000:0.0:1767317537.132026:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x55:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d85e 00000080:00010000:0.0:1767317537.132032:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d85e from it ffffa7f7c1c1fcd8 00010000:00010000:0.0:1767317537.132036:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132044:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.132061:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.132068:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132077:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132083:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132102:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.132111:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.132116:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132124:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132132:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132139:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.132190:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767317537.132205:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.132547:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317537.132557:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.132566:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317537.133935:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787648:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317537.134098:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317537.147211:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787648:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317537.148232:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.148256:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.148288:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x5:0x0]) in obj [0x240000405:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767317537.148308:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.148322:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767317537.149643:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787776:192.168.202.133@tcp:37:rm.0 00000100:00100000:0.0:1767317537.150657:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317537.163583:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291787776:192.168.202.133@tcp:37:rm.0 00010000:00010000:0.0:1767317537.165514:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.165542:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.165628:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767317537.165654:0:83367:0:(file.c:424:ll_file_release()) START file d70.sanity-flr:[0x200000405:0x55:0x0](ffff8c3c48514b08), flags 704000 00000002:00100000:0.0:1767317537.166099:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c42efd180 x1853164291787520/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317537.166132:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317537.166139:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efce00 x1853164291788032/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317537.166167:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788032:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317537.170377:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:0.0:1767317537.178850:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788032:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317537.178947:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c42efd180 x1853164291787520/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317537.179056:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.179081:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.179105:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.179121:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.179131:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.179138:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.179143:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d857 00000080:00010000:0.0:1767317537.179151:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d857 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317537.179156:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.179166:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.179217:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.179243:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=0 00000080:00200000:0.0:1767317537.179252:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.179260:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.179267:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.179275:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.179281:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.179285:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.179287:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d857 00000080:00010000:0.0:1767317537.179291:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d857 from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317537.179293:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.179300:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.179308:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317537.179314:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317537.179340:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.179737:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.179937:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.179946:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.179953:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317537.179957:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0600/0x73c3d5cb1442d85e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ab5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.179977:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0800/0x73c3d5cb1442d857 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73a99 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317537.179998:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317537.180009:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a38700 x1853164291788288/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.180039:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788288:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.180159:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.186779:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317537.187343:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379240960 00000100:00100000:3.0:1767317537.187358:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379240960 00000100:00100000:3.0:1767317537.187557:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9530 00000100:00100000:3.0:1767317537.187570:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379240960:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317537.187595:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.187745:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317537.187753:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:25133:x1853164379240960:12345-192.168.202.133@tcp:104: Request processed in 186us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317537.187762:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9530 00010000:00010000:0.0:1767317537.188113:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317537.188122:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188133:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317537.188140:0:42099:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188150:0:42099:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188162:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188504:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188512:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317537.188604:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291788416:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317537.188732:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188742:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d865 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ac3 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.188763:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317537.188765:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317537.188767:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317537.198688:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317537.198926:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317537.198977:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379241216 00000100:00100000:3.0:1767317537.198993:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379241216 00000100:00100000:3.0:1767317537.199071:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9531 00000100:00100000:3.0:1767317537.199082:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379241216:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317537.199105:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.199536:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317537.199547:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15482:x1853164379241216:12345-192.168.202.133@tcp:104: Request processed in 465us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317537.199556:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9531 00010000:00010000:3.0:1767317537.199910:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767317537.199920:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.199932:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:3.0:1767317537.199938:0:50308:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.199947:0:50308:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.199957:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.200104:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.200112:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317537.200155:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 1/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.200162:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d86c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73ad1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.200199:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317537.200202:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317537.200204:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317537.201617:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291788416:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317537.203198:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291788544:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317537.208810:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291788544:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317537.226617:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a38700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788288:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.226714:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x55:0x0](ffff8c3c48514b08) 00000080:00200000:0.0:1767317537.226845:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.226943:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.227022:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.227034:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.227046:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.227071:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788672:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.227216:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.232818:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788672:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.232864:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.232950:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.232966:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.232978:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.232990:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.233146:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.233152:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.233161:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291788672/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.233183:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.233201:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317537.233350:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.233462:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.233471:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d87a 00000080:00010000:0.0:1767317537.233478:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.233482:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d87a from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.233486:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.233709:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.233745:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.233769:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.233774:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.233801:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d71.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.234544:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.234555:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.234565:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.234592:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788800:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.234706:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.238167:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788800:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.238207:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238331:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238340:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238353:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238436:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238452:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238461:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238485:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.238494:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291788800/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/584 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.238504:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.238514:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 9663677444/463 (0 0) 00000002:00010000:0.0:1767317537.238533:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000404:0x1cf:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.238585:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.238589:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.238596:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.238614:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788928:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.238751:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.245941:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291788928:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.245981:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.245996:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246050:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246064:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246081:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246089:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246097:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.246111:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42eff480 x1853164291788928/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/672 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.246129:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.246145:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/463 (0 0) 00000080:00200000:0.0:1767317537.246188:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.246257:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000002:00010000:0.0:1767317537.246291:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.246351:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.246360:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.246391:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.246415:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789056:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.246547:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.252523:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789056:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.252560:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 4/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252576:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 4/1,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252592:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252605:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252618:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252626:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252633:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.252646:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd180 x1853164291789056/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.252770:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252787:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677443/3 (0 0) 00010000:00010000:0.0:1767317537.252796:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.252804:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.253463:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.257309:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.257336:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.257350:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.257476:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789184:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.257698:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.261864:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789184:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.261990:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262005:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262021:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262034:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262048:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262057:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262064:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.262077:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c2680 x1853164291789184/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/640 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.262095:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262112:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935617/6 (0 0) 00010000:00010000:1.0:1767317537.262122:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262141:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.262193:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1cf:0x0], updating i_size 8192 00000080:00010000:1.0:1767317537.262208:0:83367:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for remote lock 0x73c3d5cb1442d888 00000080:00010000:1.0:1767317537.262214:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d881 00000080:00010000:1.0:1767317537.262447:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000080:00010000:1.0:1767317537.262453:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d881 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317537.262457:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262465:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767317537.262474:0:83367:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x73c3d5cb1442d888 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317537.262478:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262486:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317537.262528:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.262537:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08),name=d71.sanity-flr 00000002:00010000:1.0:1767317537.262569:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1cf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.262580:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262603:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.262613:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.262620:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262627:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262636:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262643:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.262652:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.262657:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262918:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262930:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262937:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.262964:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317537.262970:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000080:00010000:1.0:1767317537.262974:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d888 00000080:00010000:1.0:1767317537.262978:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d888 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.262981:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.262987:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.263000:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.263006:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263015:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263022:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263030:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.263037:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.263043:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263050:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263064:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263072:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.263145:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.263155:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.263163:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263171:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.263186:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.263191:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.263193:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d87a 00000080:00010000:1.0:1767317537.263198:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d87a from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317537.263200:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.263207:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.263216:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.263224:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=266 00000080:00200000:1.0:1767317537.263577:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317537.263589:0:83367:0:(file.c:1001:ll_file_open()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), flags 704400 00000002:00010000:1.0:1767317537.263618:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1cf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767317537.263802:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.263812:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317537.263826:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317537.263848:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2680 x1853164291789440/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317537.263859:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.264460:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789440:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.264924:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.271855:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789440:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.271923:0:83367:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.271940:0:83367:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.271948:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.271956:0:83367:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.271964:0:83367:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.271998:0:83367:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0e00 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317537.272004:0:83367:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.272013:0:83367:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.272022:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.272030:0:83367:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767317537.272039:0:83367:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.272046:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83367 initiator: MDT0 00000002:00100000:1.0:1767317537.272083:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8c3c437c2680 x1853164291789440/t4294976365(4294976365) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317537.272099:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2680 x1853164291789440/t4294976365(4294976365) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.272119:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.272165:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1cf:0x0], updating i_size 4096 00000002:00100000:1.0:1767317537.272207:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c2680 x1853164291789440/t4294976365(4294976365) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767317537.272652:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.272675:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08),name=d71.sanity-flr 00000002:00010000:1.0:1767317537.272704:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1cf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.272729:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272744:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.272756:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.272763:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272771:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272782:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272791:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.272809:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.272817:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272825:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272833:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.272840:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.272860:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767317537.272868:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000080:00010000:1.0:1767317537.273359:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d888 00000080:00010000:1.0:1767317537.273376:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d888 from it ffffa7f7c1c1fcd8 00010000:00010000:1.0:1767317537.273380:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273388:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.273405:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.273412:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273420:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273427:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273434:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.273442:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.273447:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273453:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273469:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273476:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.273516:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767317537.273530:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.273561:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317537.273567:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.273576:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317537.275211:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789568:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317537.275615:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.317802:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789568:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317537.318627:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.318651:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.318685:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767317537.318727:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.318743:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767317537.319393:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789696:192.168.202.133@tcp:37:rm.0 00000100:00100000:1.0:1767317537.319545:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.352254:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789696:192.168.202.133@tcp:37:rm.0 00010000:00010000:1.0:1767317537.353061:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.353080:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767317537.353167:0:83367:0:(file.c:424:ll_file_release()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), flags 704000 00000002:00100000:1.0:1767317537.353263:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c2680 x1853164291789440/t4294976365(4294976365) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.353275:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.353279:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291789952/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.353301:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789952:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.353435:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.359395:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291789952:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.359436:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c2680 x1853164291789440/t4294976365(4294976365) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.359549:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.359570:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.359589:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.359601:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.359608:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.359613:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.359616:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d87a 00000080:00010000:1.0:1767317537.359623:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d87a from it ffffa7f7c1c1fbf8 00010000:00010000:1.0:1767317537.359626:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.359632:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.359645:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.359651:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=266 00000080:00200000:1.0:1767317537.359658:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), inode mode 41ed mask 44 00000080:00200008:1.0:1767317537.359667:0:83367:0:(file.c:1001:ll_file_open()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), flags 704400 00000002:00010000:1.0:1767317537.359685:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1cf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767317537.359752:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.359759:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000020:00100000:1.0:1767317537.359779:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767317537.359784:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291790208/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/133808 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767317537.359791:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.359811:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790208:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.360574:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.364599:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790208:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.364644:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.364654:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 4/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.364666:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.364678:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.364695:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8c3c437c0700 x1853164291790208/t4294976367(4294976367) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767317537.364709:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291790208/t4294976367(4294976367) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 2600/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.364728:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.364759:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 16 res 9663677444/463 (0 0) 00000080:00200000:1.0:1767317537.364766:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.364807:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1cf:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.364815:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d8a4 00000080:00010000:1.0:1767317537.364824:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8a4 from it ffffa7f7c1c1fbd0 00010000:00010000:1.0:1767317537.364840:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.364853:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317537.365240:0:83367:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8c3c437c0700 x1853164291790208/t4294976367(4294976367) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767317537.365327:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317537.365334:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08),name=d71.sanity-flr 00000002:00010000:2.0:1767317537.365356:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000404:0x1cf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365366:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365376:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365383:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365387:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365392:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365397:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365401:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365409:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365414:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365425:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365429:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365433:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.365441:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767317537.365445:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000080:00010000:2.0:1767317537.365448:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1cf:0x0](ffff8c3c48514b08) for lock 0x73c3d5cb1442d888 00000080:00010000:2.0:1767317537.365450:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d888 from it ffffa7f7c1c1fcd8 00010000:00010000:2.0:1767317537.365452:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365456:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365463:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365467:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365471:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365476:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365488:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365494:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365497:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365500:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365505:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365510:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.365545:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) pos/size0/8192 32bit_api 0 00010000:00010000:2.0:1767317537.365555:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365573:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317537.365577:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365582:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:2.0:1767317537.365594:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:2.0:1767317537.365597:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365605:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.365613:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767317537.365615:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365620:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00200000:2.0:1767317537.365628:0:83367:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:2.0:1767317537.365630:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.365634:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.365664:0:83367:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:2.0:1767317537.365695:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.365715:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f71.sanity-flr, dir=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), flags=0 00000080:00200000:2.0:1767317537.365719:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f71.sanity-flr, dir=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), intent=getattr 00000002:00010000:2.0:1767317537.365738:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f71.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.365795:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.365801:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.365809:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317537.366122:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790336:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317537.366351:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09df00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.371445:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3ad80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790336:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.371488:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371520:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371530:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371545:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371559:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371573:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371610:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 5/2,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.371617:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.371630:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3ad80 x1853164291790336/t0(0) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.371642:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.371658:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.371683:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c499d7800 type 13 mode 4 res 9663677444/464 (0 0) 00000080:00200000:0.0:1767317537.371693:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000403:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.371739:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000404:0x1d0:0x0](ffff8c3c485121c8) 00000080:00200000:0.0:1767317537.372457:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000404:0x1d0:0x0], updating i_size 0 00000080:00200000:0.0:1767317537.372508:0:83367:0:(file.c:6809:ll_layout_conf()) [0x240000404:0x1d0:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:0.0:1767317537.372517:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000404:0x1d0:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d8ab 00000080:00010000:0.0:1767317537.372531:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000404:0x1d0:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317537.372535:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ab from it ffffa7f7c1c1fdf8 00010000:00010000:0.0:1767317537.372540:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.372553:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.372616:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08), inode mode 41ed mask 3 00000080:00200000:0.0:1767317537.372627:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f71.sanity-flr, dir=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00010000:00010000:0.0:1767317537.372778:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.373142:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.373158:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x240000404:0x1d0:0x0]: losing layout lock 00010000:00010000:0.0:1767317537.373223:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.373232:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 1/0,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.373238:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317537.373241:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1a00/0x73c3d5cb1442d8ab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73b9c expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.373261:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d88f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b4f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317537.373281:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317537.373295:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd180 x1853164291790592/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317537.373325:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790592:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317537.373454:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.379351:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790592:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.379436:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x240000404:0x1d0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.379451:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000404:0x1d0:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317537.379454:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.379463:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317537.379497:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x240000404:0x1d0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317537.379507:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x1d0:0x0](ffff8c3c485121c8) 00000080:00200008:0.0:1767317537.379627:0:83367:0:(file.c:424:ll_file_release()) START file d71.sanity-flr:[0x240000404:0x1cf:0x0](ffff8c3c48514b08), flags 704000 00010000:00010000:0.0:1767317537.379761:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.380131:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.380159:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.380309:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380323:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.380332:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.380340:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.380344:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d87a 00000080:00010000:0.0:1767317537.380353:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d87a from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317537.380357:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380367:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.380411:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.380423:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=0 00000080:00200000:0.0:1767317537.380430:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.380437:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.380444:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380452:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.380459:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.380463:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.380465:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d87a 00000080:00010000:0.0:1767317537.380468:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d87a from it ffffa7f7c1c1fd88 00010000:00010000:0.0:1767317537.380471:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380479:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.380486:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317537.380492:0:83367:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317537.380514:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380568:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.380584:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767317537.380683:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291790720:192.168.202.133@tcp:103:rm.0 00010000:00010000:0.0:1767317537.381183:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d881 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b33 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.381222:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.381268:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c0700 x1853164291790208/t4294976367(4294976367) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317537.381282:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317537.381288:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efed80 x1853164291790976/t0(0) o35->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2576 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317537.381306:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790976:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317537.381355:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 11 seconds 00000100:00100000:3.0:1767317537.394423:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291790976:192.168.202.133@tcp:35:rm.0 00000002:00100000:3.0:1767317537.394472:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c0700 x1853164291790208/t4294976367(4294976367) o101->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 608/696 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767317537.394538:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.394600:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.394608:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.394614:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317537.394618:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0e00/0x73c3d5cb1442d8a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b79 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.394631:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d888 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73b41 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317537.394680:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317537.394687:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1f80 x1853164291791232/t0(0) o36->lustre-MDT0001-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317537.394714:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791232:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317537.394842:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.395100:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291790720:192.168.202.133@tcp:103:rm.0 00000100:00100000:2.0:1767317537.399557:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317537.399672:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379242368 00000100:00100000:3.0:1767317537.399687:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379242368 00000100:00100000:3.0:1767317537.399769:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9532 00000100:00100000:3.0:1767317537.399783:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379242368:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317537.399808:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.400143:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317537.400153:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379242368:12345-192.168.202.133@tcp:104: Request processed in 373us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317537.400162:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9532 00010000:00010000:0.0:1767317537.400230:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317537.400240:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400250:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc600 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:0.0:1767317537.400257:0:42098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400265:0:42098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400302:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400384:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400392:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317537.400422:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400429:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d87a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b17 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.400454:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317537.400456:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317537.400458:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317537.400479:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291791360:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317537.406768:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291791360:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317537.415232:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317537.415351:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379243264 00000100:00100000:3.0:1767317537.415365:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379243264 00000100:00100000:3.0:1767317537.415439:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9533 00000100:00100000:3.0:1767317537.415452:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379243264:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317537.415474:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.415572:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317537.415580:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:15483:x1853164379243264:12345-192.168.202.133@tcp:104: Request processed in 131us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317537.415610:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9533 00010000:00010000:1.0:1767317537.415703:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317537.415714:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.415723:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc1bd6b40) 00010000:00010000:1.0:1767317537.415730:0:63742:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.415739:0:63742:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.415748:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.415968:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.415984:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317537.416009:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.416016:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x541306ba06a73b5d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.416035:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317537.416037:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317537.416039:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317537.416205:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317537.416228:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291791488:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317537.423726:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291791488:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317537.447720:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791232:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317537.447778:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000404:0x1cf:0x0](ffff8c3c48514b08) 00000080:00200000:3.0:1767317537.447964:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.447991:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.448068:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.448079:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.448091:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317537.448116:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791616:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317537.448249:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.463319:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791616:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317537.463362:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463380:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463397:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463411:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463454:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463464:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463473:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317537.463488:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1c00 x1853164291791616/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317537.463505:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463522:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1767317537.463531:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317537.463571:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1767317537.463579:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8b2 00000080:00010000:3.0:1767317537.463586:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.463590:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8b2 from it ffffa7f7c1c1fb58 00010000:00010000:3.0:1767317537.463593:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.463601:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.463634:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317537.463681:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:3.0:1767317537.463686:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317537.463717:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0g.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.463776:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.463784:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.463796:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317537.463821:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791744:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317537.463984:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.476683:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291791744:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317537.476723:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476752:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476762:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476777:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476791:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476849:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476858:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.476867:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317537.476925:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc1c00 x1853164291791744/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/928 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317537.476939:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317537.476957:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.476970:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/27 (0 0) 00000080:00200000:3.0:1767317537.476978:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317537.477022:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff8c3c597d80c8) 00000080:00200000:3.0:1767317537.477109:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1b:0x0], updating i_size 158 00000080:00200000:3.0:1767317537.477138:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1b:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:3.0:1767317537.477146:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1b:0x0](ffff8c3c597d80c8) for lock 0x73c3d5cb1442d8b9 00000080:00010000:3.0:1767317537.477160:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1b:0x0](ffff8c3c597d80c8) 00000080:00010000:3.0:1767317537.477164:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8b9 from it ffffa7f7c1c1fb20 00010000:00010000:3.0:1767317537.477168:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.477197:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317537.477245:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f0g.sanity-flr:[0x200000402:0x1b:0x0](ffff8c3c597d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317537.477254:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff8c3c597d80c8),name=f0g.sanity-flr 00000002:00010000:3.0:1767317537.477283:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.477293:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.477306:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.477312:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.477318:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1b:0x0](ffff8c3c597d80c8) 00000080:00010000:3.0:1767317537.477322:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1b:0x0](ffff8c3c597d80c8) for lock 0x73c3d5cb1442d8b9 00000080:00010000:3.0:1767317537.477325:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8b9 from it ffffa7f7c1c1fcb8 00010000:00010000:3.0:1767317537.477328:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.477336:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.477404:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.477412:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.477420:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477443:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.477450:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.477454:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.477457:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8b2 00000080:00010000:3.0:1767317537.477462:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8b2 from it ffffa7f7c1c1fc10 00010000:00010000:3.0:1767317537.477465:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477473:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.477482:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317537.477493:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f0g.sanity-flr, flags=0 00000080:00200000:3.0:1767317537.477499:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.477506:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.477511:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477519:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.477525:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.477528:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.477531:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8b2 00000080:00010000:3.0:1767317537.477535:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8b2 from it ffffa7f7c1c1fd68 00010000:00010000:3.0:1767317537.477538:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477551:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.477560:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767317537.477566:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:3.0:1767317537.477592:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477621:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.477631:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1b:0x0]: losing layout lock 00010000:00010000:3.0:1767317537.477672:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.477679:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.477686:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317537.477689:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73c28 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.477713:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c0c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317537.477735:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317537.477743:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc1c00 x1853164291792000/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317537.477784:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792000:192.168.202.133@tcp:36:rm.0 00000100:00100000:3.0:1767317537.477972:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.487443:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792000:192.168.202.133@tcp:36:rm.0 00000080:00200000:3.0:1767317537.487529:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767317537.487546:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767317537.487550:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767317537.487557:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x16 00020000:00200000:3.0:1767317537.487569:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x6 00000080:00200000:3.0:1767317537.487593:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767317537.487602:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff8c3c597d80c8) 00000080:00200000:3.0:1767317537.487730:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.487758:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.487834:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.487856:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.487867:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317537.488191:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792128:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317537.488308:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.493935:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792128:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317537.493972:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494012:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494027:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494041:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494056:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494065:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494073:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317537.494087:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3800 x1853164291792128/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317537.494105:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494120:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1767317537.494128:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767317537.494164:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1767317537.494171:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8c0 00000080:00010000:3.0:1767317537.494191:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.494202:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8c0 from it ffffa7f7c1c1fb58 00010000:00010000:3.0:1767317537.494206:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.494216:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.494251:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317537.494277:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:3.0:1767317537.494283:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:3.0:1767317537.494314:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0j.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.494369:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.494377:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.494387:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317537.494415:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792256:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317537.494529:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.500217:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792256:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317537.500253:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500283:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500293:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500327:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500340:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500354:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500362:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500369:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317537.500382:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3800 x1853164291792256/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317537.500394:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767317537.500409:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.500419:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/30 (0 0) 00000080:00200000:3.0:1767317537.500428:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767317537.500474:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff8c3c597d80c8) 00000080:00200000:3.0:1767317537.500554:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1e:0x0], updating i_size 1516 00000080:00200000:3.0:1767317537.500580:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1e:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:3.0:1767317537.500592:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1e:0x0](ffff8c3c597d80c8) for lock 0x73c3d5cb1442d8c7 00000080:00010000:3.0:1767317537.500606:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1e:0x0](ffff8c3c597d80c8) 00000080:00010000:3.0:1767317537.500610:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8c7 from it ffffa7f7c1c1fb20 00010000:00010000:3.0:1767317537.500613:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.500622:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767317537.500667:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f0j.sanity-flr:[0x200000402:0x1e:0x0](ffff8c3c597d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767317537.500675:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff8c3c597d80c8),name=f0j.sanity-flr 00000002:00010000:3.0:1767317537.500702:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.500711:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.500723:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.500730:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.500735:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1e:0x0](ffff8c3c597d80c8) 00000080:00010000:3.0:1767317537.500739:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1e:0x0](ffff8c3c597d80c8) for lock 0x73c3d5cb1442d8c7 00000080:00010000:3.0:1767317537.500742:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8c7 from it ffffa7f7c1c1fcb8 00010000:00010000:3.0:1767317537.500746:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.500753:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.500810:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.500828:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.500846:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500855:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.500861:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.500865:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.500868:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8c0 00000080:00010000:3.0:1767317537.500924:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8c0 from it ffffa7f7c1c1fc10 00010000:00010000:3.0:1767317537.500927:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500935:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.500944:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767317537.500955:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f0j.sanity-flr, flags=0 00000080:00200000:3.0:1767317537.500961:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.500968:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.500974:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.500982:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.500989:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767317537.500993:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:3.0:1767317537.500995:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8c0 00000080:00010000:3.0:1767317537.501006:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8c0 from it ffffa7f7c1c1fd68 00010000:00010000:3.0:1767317537.501009:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.501017:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767317537.501026:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767317537.501032:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:3.0:1767317537.501060:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.501089:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767317537.501098:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1e:0x0]: losing layout lock 00010000:00010000:3.0:1767317537.501139:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.501146:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.501152:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767317537.501155:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91e00/0x73c3d5cb1442d8c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73c6e expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767317537.501404:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d8c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c52 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767317537.501431:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767317537.501441:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c58fc3800 x1853164291792512/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.503025:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792512:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.503189:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09df00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.510731:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792512:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.510830:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.510851:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317537.510855:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.511199:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317537.511237:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317537.511248:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff8c3c597d80c8) 00000080:00200000:0.0:1767317537.511393:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.511424:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.511507:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.511518:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.511529:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.511557:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792640:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.511830:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.524634:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792640:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.524685:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524702:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524716:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524730:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524745:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524779:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524787:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.524800:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd500 x1853164291792640/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.524827:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524851:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317537.524860:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.524943:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.524951:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ce 00000080:00010000:0.0:1767317537.524958:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.524962:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ce from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.524966:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.524975:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.525006:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.525037:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.525043:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.525078:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.525138:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.525146:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.525156:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.525193:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792768:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.525316:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.539247:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291792768:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.539282:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539311:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539319:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539333:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539345:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539359:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539367:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.539396:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.539409:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd500 x1853164291792768/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/2304 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.539421:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1720 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.539438:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.539451:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/31 (0 0) 00000080:00200000:0.0:1767317537.539460:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.539505:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1f:0x0](ffff8c3c485121c8) 00000080:00200000:0.0:1767317537.539767:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1f:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:0.0:1767317537.539774:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1f:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d8d5 00000080:00010000:0.0:1767317537.539791:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1f:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317537.539795:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8d5 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317537.539799:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.540146:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317537.540256:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f1.sanity-flr:[0x200000402:0x1f:0x0](ffff8c3c485121c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.540267:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1f:0x0](ffff8c3c485121c8),name=f1.sanity-flr 00000002:00010000:0.0:1767317537.540300:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.540322:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.540336:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.540344:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.540350:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1f:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317537.540354:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1f:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d8d5 00000080:00010000:0.0:1767317537.540358:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8d5 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317537.540362:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.540370:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.540391:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.540404:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1f:0x0]: flr state: 1, move mirror from 7 to 7, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767317537.540407:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317537.540412:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1f:0x0] 00000008:00010000:0.0:1767317537.540433:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317537.540437:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287e30, osc lock ffff8c3c50c8f8f0, flags 0x400000400001002 00010000:00010000:0.0:1767317537.540505:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.540516:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.540532:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c42efd500 x1853164291792896/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767317537.540582:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767317537.540605:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291792896:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.544340:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544380:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544399:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544414:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317537.544434:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317537.544448:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317537.544472:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544482:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544490:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.544526:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317537.544552:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291792896:192.168.202.133@tcp:101:rm.0 00000080:00200000:2.0:1767317537.544855:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x1f:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767317537.544864:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_release():245 00000020:00010000:2.0:1767317537.544868:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317537.545328:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287e30 (ffff8c3c547fd098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317537.545334:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b10000 (ffff8c3c547fd488/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317537.545337:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287e30 (ffff8c3c547fd488/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317537.545356:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1f:0x0] ignore/verify layout 0/1, layout version 16 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317537.545428:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.545458:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.545480:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545495:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.545504:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.545513:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.545518:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ce 00000080:00010000:2.0:1767317537.545525:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ce from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317537.545529:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545549:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.545563:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.545575:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1.sanity-flr, flags=0 00000080:00200000:2.0:1767317537.545581:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.545588:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.545594:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545601:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.545607:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.545610:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.545612:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ce 00000080:00010000:2.0:1767317537.545616:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ce from it ffffa7f7c1c1fd68 00010000:00010000:2.0:1767317537.545619:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545626:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.545634:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317537.545640:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317537.545676:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545722:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.545736:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1f:0x0]: losing layout lock 00010000:00010000:2.0:1767317537.545790:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.545802:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.545808:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317537.545811:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d8d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73cb4 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.546082:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d8ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73c98 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317537.546111:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317537.546125:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3aa00 x1853164291793152/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.546157:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793152:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.546357:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09d240 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.565856:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3aa00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793152:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.565987:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.566002:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1f:0x0]: flr state: 1, move mirror from 7 to 7, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767317537.566006:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.566013:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[7] flags 0x10 00000080:00200000:0.0:1767317537.566052:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317537.566063:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1f:0x0](ffff8c3c485121c8) 00000008:00010000:0.0:1767317537.566151:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317537.566721:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.566752:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.567002:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.567014:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.567026:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.567057:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793280:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.567212:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.583255:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793280:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.583291:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583307:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583322:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583334:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583349:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583358:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583367:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.583381:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd500 x1853164291793280/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.583398:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583414:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317537.583448:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.583483:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.583491:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8e3 00000080:00010000:0.0:1767317537.583498:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.583501:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8e3 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.583505:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.583514:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.583545:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.583571:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.583576:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.583604:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f202.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.583660:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.583669:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.583680:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.583708:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793408:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.583828:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.589090:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793408:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.589126:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589193:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589203:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589218:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589231:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589245:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589254:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.589261:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.589274:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd500 x1853164291793408/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/848 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.589288:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.589304:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.589327:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/98 (0 0) 00000080:00200000:0.0:1767317537.589337:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.589381:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x62:0x0](ffff8c3c485121c8) 00000080:00200000:0.0:1767317537.589500:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x62:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317537.589507:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x62:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d8ea 00000080:00010000:0.0:1767317537.589523:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x62:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317537.589527:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ea from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317537.589531:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.589540:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317537.589594:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f202.sanity-flr:[0x200000405:0x62:0x0](ffff8c3c485121c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.589603:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x62:0x0](ffff8c3c485121c8),name=f202.sanity-flr 00000002:00010000:0.0:1767317537.589634:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x62:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.589643:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.589657:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.589665:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.589670:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x62:0x0](ffff8c3c485121c8) 00000080:00010000:0.0:1767317537.589674:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x62:0x0](ffff8c3c485121c8) for lock 0x73c3d5cb1442d8ea 00000080:00010000:0.0:1767317537.589678:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ea from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317537.589682:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.589696:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.589719:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x62:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767317537.589731:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x62:0x0] 00000008:00010000:0.0:1767317537.589752:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317537.589757:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c4a178630, osc lock ffff8c3c50c8e980, flags 0x400001002 00000008:00010000:0.0:1767317537.589796:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317537.589798:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c4a178670, osc lock ffff8c3c50c8e130, flags 0x400001002 00010000:00010000:0.0:1767317537.589953:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.589963:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317537.590039:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317537.590061:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291793536:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.594783:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.594819:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317537.594868:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:0.0:1767317537.594915:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291793664:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.613530:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613596:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613615:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613628:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317537.613648:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 2097152, setting rss=2097152; kms=2097152, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317537.613673:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317537.613679:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613688:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613696:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613704:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317537.613732:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291793664:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.613761:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613773:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613782:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.613792:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317537.613802:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1048576, setting rss=1048576; kms=1048576, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317537.614123:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317537.614144:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.614153:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.614161:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.614167:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317537.614226:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291793536:192.168.202.133@tcp:101:rm.0 00000080:00200000:2.0:1767317537.614354:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x62:0x0] updating i_size 2097152 i_blocks 4096 00000020:00010000:2.0:1767317537.614362:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b12910 (ffff8c3c547fd248/0) at cl_lock_release():245 00000020:00010000:2.0:1767317537.614366:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b12910 (ffff8c3c547fd248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767317537.614372:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c4a178630 (ffff8c3c5a084c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317537.614378:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c4a178670 (ffff8c3c547fd758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767317537.614388:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b12910 (ffff8c3c547fd248/0) at cl_lock_fini():72 00000020:00010000:2.0:1767317537.614392:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c4a178630 (ffff8c3c547fd248/1) at cl_lock_fini():72 00000020:00010000:2.0:1767317537.614396:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c4a178670 (ffff8c3c547fd248/1) at cl_lock_fini():72 00000080:00200000:2.0:1767317537.614414:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x62:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317537.614478:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.614510:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.614528:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.614542:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.614550:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.614559:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.614564:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8e3 00000080:00010000:2.0:1767317537.614571:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8e3 from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317537.614575:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.614584:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.614594:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.614606:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f202.sanity-flr, flags=0 00000080:00200000:2.0:1767317537.614612:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.614619:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.614625:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.614644:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.614651:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.614655:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.614757:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8e3 00000080:00010000:2.0:1767317537.614763:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8e3 from it ffffa7f7c1c1fd68 00010000:00010000:2.0:1767317537.614767:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.614774:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.614783:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317537.614790:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317537.615997:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.616045:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.616060:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x62:0x0]: losing layout lock 00010000:00010000:2.0:1767317537.616115:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 1/0,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.616124:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.616130:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317537.616151:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442d8ea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d01 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.616187:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d8e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ce5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317537.616210:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317537.616224:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a39180 x1853164291793920/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.616255:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793920:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.617088:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.624011:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a39180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291793920:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317537.624105:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x62:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767317537.624125:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1767317537.624140:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767317537.624189:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x62:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317537.624200:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x62:0x0](ffff8c3c485121c8) 00000008:00010000:2.0:1767317537.624250:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1048576 blocks 2048 [cma]time: 1767317119 1767317119 0 by oinfo size 1048576 blocks 2048 [cma]time 1767317119 1767317119 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767317537.624282:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 2097152 blocks 2048 [cma]time: 1767317119 1767317119 0 by oinfo size 2097152 blocks 2048 [cma]time 1767317119 1767317119 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767317537.624389:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.624419:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.624500:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.624526:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.624538:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317537.624562:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794048:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317537.624668:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00010000:00010000:2.0:1767317537.637053:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317537.640386:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794048:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317537.640421:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640437:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640453:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640466:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640479:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640487:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640495:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317537.640531:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291794048/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317537.640549:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640565:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767317537.640574:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317537.640607:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317537.640616:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ff 00000080:00010000:2.0:1767317537.640622:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.640626:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ff from it ffffa7f7c1c1fb58 00010000:00010000:2.0:1767317537.640629:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.640639:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.640669:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.640694:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:2.0:1767317537.640699:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317537.640728:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f203.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.640778:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.640786:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.640797:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317537.640846:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794176:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317537.640999:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.658387:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794176:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317537.658424:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658453:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658462:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658476:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658488:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658501:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658510:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.658518:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317537.658529:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b480 x1853164291794176/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/848 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317537.658564:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.658579:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.658590:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/100 (0 0) 00000080:00200000:2.0:1767317537.658597:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317537.658643:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x64:0x0](ffff8c3c4857a1c8) 00000080:00200000:2.0:1767317537.658742:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x64:0x0], updating i_size 0 00000080:00200000:2.0:1767317537.658772:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x64:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1767317537.658778:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x64:0x0](ffff8c3c4857a1c8) for lock 0x73c3d5cb1442d906 00000080:00010000:2.0:1767317537.658794:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x64:0x0](ffff8c3c4857a1c8) 00000080:00010000:2.0:1767317537.658798:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d906 from it ffffa7f7c1c1fb20 00010000:00010000:2.0:1767317537.658802:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.658812:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317537.659081:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f203.sanity-flr:[0x200000405:0x64:0x0](ffff8c3c4857a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317537.659092:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x64:0x0](ffff8c3c4857a1c8),name=f203.sanity-flr 00000002:00010000:2.0:1767317537.659124:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x64:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.659135:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.659148:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.659163:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.659169:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x64:0x0](ffff8c3c4857a1c8) 00000080:00010000:2.0:1767317537.659185:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x64:0x0](ffff8c3c4857a1c8) for lock 0x73c3d5cb1442d906 00000080:00010000:2.0:1767317537.659190:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d906 from it ffffa7f7c1c1fcb8 00010000:00010000:2.0:1767317537.659193:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.659200:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.659268:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.659277:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.659284:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659293:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.659300:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.659304:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.659306:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ff 00000080:00010000:2.0:1767317537.659310:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ff from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317537.659313:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659320:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.659339:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.659350:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f203.sanity-flr, flags=0 00000080:00200000:2.0:1767317537.659356:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.659363:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.659369:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659377:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.659382:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.659386:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.659389:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d8ff 00000080:00010000:2.0:1767317537.659392:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d8ff from it ffffa7f7c1c1fd68 00010000:00010000:2.0:1767317537.659395:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659402:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.659410:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317537.659416:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317537.659444:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659475:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.659500:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x64:0x0]: losing layout lock 00010000:00010000:2.0:1767317537.659540:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.659548:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.659554:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317537.659557:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d906 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d55 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.659579:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d8ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73d39 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317537.659599:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317537.659611:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3b480 x1853164291794432/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.659677:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794432:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.659794:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.666520:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794432:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317537.666605:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x64:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317537.666620:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x64:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317537.666623:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317537.666631:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767317537.666676:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x64:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317537.666686:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x64:0x0](ffff8c3c4857a1c8) 00000080:00200000:2.0:1767317537.666857:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.666906:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.666989:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.667001:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.667013:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317537.667040:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794560:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317537.667224:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.685183:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794560:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317537.685223:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685239:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685253:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685266:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685280:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685289:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685319:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317537.685332:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3a300 x1853164291794560/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317537.685349:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685365:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767317537.685374:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767317537.685410:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767317537.685418:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d90d 00000080:00010000:2.0:1767317537.685425:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.685428:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d90d from it ffffa7f7c1c1fb58 00010000:00010000:2.0:1767317537.685432:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.685440:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.685471:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.685499:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:2.0:1767317537.685504:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:2.0:1767317537.685534:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f205a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.685589:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.685607:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317537.685618:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317537.685647:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794688:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317537.685759:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.697227:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794688:192.168.202.133@tcp:101:rm.0 00010000:00010000:2.0:1767317537.697266:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697295:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697304:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697317:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697329:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697342:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697351:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.697383:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767317537.697397:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3a300 x1853164291794688/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767317537.697411:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767317537.697426:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.697437:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/117 (0 0) 00000080:00200000:2.0:1767317537.697446:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767317537.697495:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x75:0x0](ffff8c3c4857a1c8) 00000080:00200000:2.0:1767317537.697579:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x75:0x0], updating i_size 0 00000080:00200000:2.0:1767317537.697607:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x75:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:2.0:1767317537.697613:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff8c3c4857a1c8) for lock 0x73c3d5cb1442d914 00000080:00010000:2.0:1767317537.697628:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff8c3c4857a1c8) 00000080:00010000:2.0:1767317537.697632:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d914 from it ffffa7f7c1c1fb20 00010000:00010000:2.0:1767317537.697636:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.697646:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767317537.697691:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f205a.sanity-flr:[0x200000405:0x75:0x0](ffff8c3c4857a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767317537.697699:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x75:0x0](ffff8c3c4857a1c8),name=f205a.sanity-flr 00000002:00010000:2.0:1767317537.697734:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x75:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.697743:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.697756:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.697763:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.697768:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff8c3c4857a1c8) 00000080:00010000:2.0:1767317537.697772:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff8c3c4857a1c8) for lock 0x73c3d5cb1442d914 00000080:00010000:2.0:1767317537.697776:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d914 from it ffffa7f7c1c1fcb8 00010000:00010000:2.0:1767317537.697779:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.697786:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.697973:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.697983:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.697991:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698000:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.698006:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.698010:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.698012:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d90d 00000080:00010000:2.0:1767317537.698016:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d90d from it ffffa7f7c1c1fc10 00010000:00010000:2.0:1767317537.698025:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698032:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.698042:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767317537.698054:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f205a.sanity-flr, flags=0 00000080:00200000:2.0:1767317537.698060:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317537.698067:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317537.698073:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698081:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.698086:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767317537.698090:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:2.0:1767317537.698092:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d90d 00000080:00010000:2.0:1767317537.698095:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d90d from it ffffa7f7c1c1fd68 00010000:00010000:2.0:1767317537.698098:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698104:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767317537.698112:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767317537.698118:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:2.0:1767317537.698144:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698199:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767317537.698209:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x75:0x0]: losing layout lock 00010000:00010000:2.0:1767317537.698255:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.698262:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767317537.698268:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767317537.698271:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0200/0x73c3d5cb1442d914 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73d9b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767317537.698294:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0400/0x73c3d5cb1442d90d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73d7f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767317537.698316:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767317537.698328:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46a3a300 x1853164291794944/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317537.698357:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794944:192.168.202.133@tcp:36:rm.0 00000100:00100000:2.0:1767317537.698482:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:2.0:1767317537.709540:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3a300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291794944:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317537.709624:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x75:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317537.709638:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x75:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767317537.709642:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317537.709674:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x16 00000080:00200000:2.0:1767317537.709711:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x75:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317537.709721:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x75:0x0](ffff8c3c4857a1c8) 00000080:00200000:2.0:1767317537.710134:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:3.0:1767317537.710301:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767317537.710376:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.710388:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:3.0:1767317537.710399:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:3.0:1767317537.710424:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795072:192.168.202.133@tcp:101:rm.0 00000100:00100000:3.0:1767317537.710536:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c600eb480 going to sleep for 12 seconds 00000100:00100000:3.0:1767317537.722864:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795072:192.168.202.133@tcp:101:rm.0 00010000:00010000:3.0:1767317537.723250:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723266:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723281:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723295:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723308:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723317:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723346:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767317537.723360:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c58fc3b80 x1853164291795072/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767317537.723375:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767317537.723392:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1767317537.723401:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.723520:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.723531:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d91b 00000080:00010000:0.0:1767317537.723538:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.723542:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d91b from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.723545:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.723555:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.723586:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.723615:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.723621:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.723655:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f205b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.723710:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.723718:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.723727:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.723755:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795200:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.723928:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.729032:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795200:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.729109:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729139:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729147:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729162:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729184:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729200:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729208:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729216:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.729229:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd500 x1853164291795200/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/928 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.729243:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.729272:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.729285:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/120 (0 0) 00000080:00200000:0.0:1767317537.729294:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.729348:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x78:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317537.729476:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x78:0x0], updating i_size 0 00000080:00200000:0.0:1767317537.729503:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x78:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767317537.729509:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x78:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d922 00000080:00010000:0.0:1767317537.729524:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x78:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317537.729527:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d922 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317537.729531:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.729540:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317537.729592:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f205b.sanity-flr:[0x200000405:0x78:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.729601:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x78:0x0](ffff8c3c485163c8),name=f205b.sanity-flr 00000002:00010000:0.0:1767317537.729629:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x78:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.729639:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.729651:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.729658:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.729682:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x78:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317537.729687:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x78:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d922 00000080:00010000:0.0:1767317537.729692:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d922 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317537.729695:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.729702:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.729766:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.729775:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.729784:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729792:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.729799:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.729804:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.729807:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d91b 00000080:00010000:0.0:1767317537.729810:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d91b from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317537.729813:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729820:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.729828:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.729839:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f205b.sanity-flr, flags=0 00000080:00200000:0.0:1767317537.729852:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.729860:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.729866:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729937:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.729944:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.729948:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.729950:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d91b 00000080:00010000:0.0:1767317537.729954:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d91b from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317537.729957:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.729964:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.729973:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317537.729980:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317537.730008:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.730039:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.730049:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x78:0x0]: losing layout lock 00010000:00010000:0.0:1767317537.730094:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.730114:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.730120:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317537.730124:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d922 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73de1 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.730145:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c90c00/0x73c3d5cb1442d91b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73dc5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317537.730180:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317537.730192:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd500 x1853164291795456/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317537.730224:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795456:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317537.730350:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.754698:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd500 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795456:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.754787:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x78:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.754803:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x78:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317537.754806:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.754816:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x416 00000080:00200000:0.0:1767317537.754945:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x78:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317537.754956:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x78:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317537.755102:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.755131:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.755227:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.755263:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.755277:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.755307:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795584:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.755427:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.759152:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795584:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.759200:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759216:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759230:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759241:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759253:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759262:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759270:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.759308:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291795584/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.759325:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759341:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317537.759348:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.759383:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.759390:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d929 00000080:00010000:0.0:1767317537.759396:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.759399:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d929 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.759403:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.759412:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.759440:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.759461:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.759466:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.759492:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f206.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.759543:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.759551:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.759560:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.759631:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795712:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.759748:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.770757:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795712:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.770799:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770832:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770853:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770869:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770924:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770940:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770951:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.770960:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.770974:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291795712/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/840 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.771011:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 256 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317537.771027:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.771038:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/123 (0 0) 00000080:00200000:0.0:1767317537.771048:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317537.771159:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.771448:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317537.771453:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.771461:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.771609:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.771720:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x7b:0x0], updating i_size 0 00000080:00200000:1.0:1767317537.771726:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x7b:0x0](ffff8c3c4857e3c8): rc = 0 00000080:00200000:1.0:1767317537.771749:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x7b:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767317537.771759:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7b:0x0](ffff8c3c4857e3c8) for lock 0x73c3d5cb1442d930 00000080:00010000:1.0:1767317537.771775:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7b:0x0](ffff8c3c4857e3c8) 00000080:00010000:1.0:1767317537.771778:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d930 from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317537.771783:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.771794:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317537.771858:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f206.sanity-flr:[0x200000405:0x7b:0x0](ffff8c3c4857e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.771867:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x7b:0x0](ffff8c3c4857e3c8),name=f206.sanity-flr 00000002:00010000:1.0:1767317537.771950:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x7b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.771963:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.771988:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.771996:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.772001:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7b:0x0](ffff8c3c4857e3c8) 00000080:00010000:1.0:1767317537.772004:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7b:0x0](ffff8c3c4857e3c8) for lock 0x73c3d5cb1442d930 00000080:00010000:1.0:1767317537.772008:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d930 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.772012:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.772019:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.772097:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.772106:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.772115:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772123:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.772129:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.772132:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.772135:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d929 00000080:00010000:1.0:1767317537.772139:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d929 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.772142:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772160:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.772386:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.772401:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f206.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.772408:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.772416:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.772423:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772433:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.772440:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.772444:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.772446:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d929 00000080:00010000:1.0:1767317537.772450:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d929 from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317537.772453:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772461:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.772469:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.772474:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.772504:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772543:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.772553:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x7b:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.772597:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.772605:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.772611:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317537.772614:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58cccc00/0x73c3d5cb1442d930 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73e27 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.772634:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd800/0x73c3d5cb1442d929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e0b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.772728:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.772743:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c2680 x1853164291795968/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.772814:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795968:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.773252:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.785680:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c2680 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291795968:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.785779:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.785796:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317537.785799:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317537.785829:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x16 00000080:00200000:1.0:1767317537.785938:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.785950:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x7b:0x0](ffff8c3c4857e3c8) 00000080:00200000:1.0:1767317537.786088:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.786113:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.786409:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.786422:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.786433:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.786494:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796096:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.786600:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.794411:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796096:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.794449:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794465:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794480:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794494:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794508:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794535:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794543:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.794558:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291796096/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.794574:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794590:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.794598:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.794635:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.794642:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d937 00000080:00010000:1.0:1767317537.794649:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.794653:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d937 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317537.794656:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.794665:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.794700:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.794728:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317537.794733:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317537.794761:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f209a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.794828:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.794849:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.794860:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.794916:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796224:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.795047:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.799510:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796224:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.799547:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799580:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799590:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799606:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799619:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799633:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799641:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.799679:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.799693:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291796224/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 592/824 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.799705:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317537.799722:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.799733:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/129 (0 0) 00000080:00200000:1.0:1767317537.799742:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317537.799810:0:83367:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x81:0x0](ffff8c3c61731148): rc = 0 00000080:00200000:1.0:1767317537.799827:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x81:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767317537.799843:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff8c3c61731148) for lock 0x73c3d5cb1442d93e 00000080:00010000:1.0:1767317537.799859:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff8c3c61731148) 00000080:00010000:1.0:1767317537.799864:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d93e from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317537.799867:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.799913:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317537.799963:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f209a.sanity-flr:[0x200000405:0x81:0x0](ffff8c3c61731148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.799972:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff8c3c61731148),name=f209a.sanity-flr 00000002:00010000:1.0:1767317537.800001:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.800019:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.800032:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.800039:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.800044:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff8c3c61731148) 00000080:00010000:1.0:1767317537.800048:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff8c3c61731148) for lock 0x73c3d5cb1442d93e 00000080:00010000:1.0:1767317537.800052:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d93e from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.800056:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.800064:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.800086:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.800101:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317537.800104:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317537.800107:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:1.0:1767317537.800128:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317537.800132:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8730, osc lock ffff8c3c60dd1c80, flags 0x400000400001002 00010000:00010000:1.0:1767317537.800207:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.800216:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.800227:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c437c0700 x1853164291796352/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317537.800333:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291796352:192.168.202.133@tcp:101:rm.0 00000020:00200000:1.0:1767317537.803043:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767317537.812061:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812097:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812115:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812131:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317537.812150:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317537.812205:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317537.812292:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812302:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812309:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317537.812318:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317537.812344:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291796352:192.168.202.133@tcp:101:rm.0 00000080:00200000:1.0:1767317537.818534:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1767317537.818554:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:1.0:1767317537.818563:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.818570:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8730 (ffff8c3c547fd5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.818577:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317537.818580:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8730 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317537.818605:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.818688:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.818719:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.818742:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.818760:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.818770:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.818780:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.818784:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d937 00000080:00010000:1.0:1767317537.818792:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d937 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.818797:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.818806:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.818827:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.819018:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209a.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.819025:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.819034:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.819042:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.819052:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.819059:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.819064:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.819066:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d937 00000080:00010000:1.0:1767317537.819071:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d937 from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317537.819074:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.819082:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.819091:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.819098:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.819135:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.819167:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.819190:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x81:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.819240:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.819260:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.819266:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317537.819270:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d93e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73e6d expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.819293:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e51 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.819318:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.819334:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0e00 x1853164291796608/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.819365:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796608:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.819505:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a900 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.843255:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0e00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796608:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.843345:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317537.843361:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317537.843364:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317537.843372:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.843407:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.843416:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x81:0x0](ffff8c3c61731148) 00000008:00010000:1.0:1767317537.843461:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1767317435 1767317435 1767317430 by oinfo size 5 blocks 8 [cma]time 1767317435 1767317435 1767317430 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317537.843648:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.843687:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.843764:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.843773:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.843783:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.843810:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796736:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.843982:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.874110:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796736:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.874147:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874163:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874191:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874204:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874218:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874248:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874255:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.874268:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c1180 x1853164291796736/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.874286:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874303:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.874311:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.874347:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.874354:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d94c 00000080:00010000:1.0:1767317537.874361:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.874364:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d94c from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317537.874368:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874377:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.874408:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.874425:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209b.sanity-flr, flags=8 00000080:00200008:1.0:1767317537.874440:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f209b.sanity-flr:[0x200000405:0x84:0x0](ffff8c3c61735348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.874447:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x84:0x0](ffff8c3c61735348),name=f209b.sanity-flr 00000002:00010000:1.0:1767317537.874482:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x84:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.874494:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.874508:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.874517:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.874522:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x84:0x0](ffff8c3c61735348) 00000080:00010000:1.0:1767317537.874525:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x84:0x0](ffff8c3c61735348) for lock 0x73c3d5cb1442cd98 00000080:00010000:1.0:1767317537.874529:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442cd98 from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.874533:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.874541:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.874572:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x84:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767317537.874587:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x84:0x0] 00000008:00010000:1.0:1767317537.874614:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317537.874620:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8530, osc lock ffff8c3c60dd1c80, flags 0x400001002 00010000:00010000:1.0:1767317537.874643:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.874653:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317537.874668:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317537.874672:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.874687:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317537.874700:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317537.874717:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x84:0x0] updating i_size 8192 i_blocks 16 00000020:00010000:1.0:1767317537.874722:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:1.0:1767317537.874726:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.874729:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8530 (ffff8c3c547fd5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.874734:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317537.874737:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8530 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317537.874751:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x84:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.874805:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.874815:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.874822:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874844:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.874851:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.874856:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.874859:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d94c 00000080:00010000:1.0:1767317537.874863:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d94c from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.874866:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874935:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.874945:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.874954:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209b.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.874959:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.874967:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.874974:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.874983:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.874989:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.874994:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.874996:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d94c 00000080:00010000:1.0:1767317537.875000:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d94c from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317537.875003:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.875011:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.875019:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.875025:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f209b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.875054:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.875097:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0000/0x73c3d5cb1442cd9f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x84:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71205 expref: -99 pid: 79381 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317537.875154:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9f100 x1853164291622272/t8589937158(8589937158) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317481 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.875180:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.875188:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291796992/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.875217:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796992:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.875361:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.882151:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291796992:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.882216:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9f100 x1853164291622272/t8589937158(8589937158) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/664 e 0 to 0 dl 1767317481 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.882269:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x84:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.882304:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.882319:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x84:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.882368:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0000/0x73c3d5cb1442cd9f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x84:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71205 expref: -99 pid: 79381 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.882377:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.882384:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.882411:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317537.882414:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0000/0x73c3d5cb1442cd9f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x84:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71205 expref: -99 pid: 79381 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.882428:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1400/0x73c3d5cb1442cd98 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a711f0 expref: -99 pid: 79372 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.882442:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d94c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73e9e expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.882465:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.882473:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c1180 x1853164291797248/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 512/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.882500:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797248:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.882669:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.893851:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c1180 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797248:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.893977:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x84:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.893995:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.894032:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x84:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.894118:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x84:0x0](ffff8c3c61735348) 00000008:00010000:1.0:1767317537.894158:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 8192 blocks 16 [cma]time: 1767317464 1767317464 0 by oinfo size 8192 blocks 16 [cma]time 1767317464 1767317464 1767317464 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317537.894258:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.894283:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.894365:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.894373:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.894383:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.894404:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797376:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.894504:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.897443:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797376:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.897476:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897491:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897506:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897519:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897533:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897542:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897551:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.897588:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c0700 x1853164291797376/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.897607:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897625:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.897633:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.897682:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.897691:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d953 00000080:00010000:1.0:1767317537.897698:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.897701:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d953 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317537.897705:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.897716:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.897751:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.897769:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200008:1.0:1767317537.897786:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff8c3c597df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.897794:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448),name=f211.sanity-flr 00000002:00010000:1.0:1767317537.897823:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.897845:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.897856:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.897906:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.897912:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) 00000080:00010000:1.0:1767317537.897915:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff8c3c597df448) for lock 0x73c3d5cb1442d01c 00000080:00010000:1.0:1767317537.897920:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d01c from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.897923:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.897931:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.897957:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767317537.897970:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767317537.897998:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317537.898002:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8530, osc lock ffff8c3c60dd1c80, flags 0x400001002 00010000:00010000:1.0:1767317537.898021:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.898031:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317537.898045:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317537.898049:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317537.898057:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317537.898080:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767317537.898095:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767317537.898100:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:1.0:1767317537.898104:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.898107:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8530 (ffff8c3c547fd5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317537.898111:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317537.898114:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8530 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317537.898127:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.898182:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.898193:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.898200:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.898208:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.898214:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.898218:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.898221:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d953 00000080:00010000:1.0:1767317537.898225:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d953 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.898228:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.898235:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.898243:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.898261:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.898266:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.898273:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.898278:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.898286:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.898292:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.898295:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.898297:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d953 00000080:00010000:1.0:1767317537.898301:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d953 from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317537.898304:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.898310:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.898317:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.898323:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.898350:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.898377:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.898387:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.898397:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317537.898461:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317522 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.898473:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.898479:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291797632/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.898506:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797632:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.898628:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.908031:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797632:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.908101:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c437c3b80 x1853164291667200/t8589937244(8589937244) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 656/744 e 0 to 0 dl 1767317522 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.908158:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.908207:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.908224:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.908279:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908287:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908294:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908302:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.908339:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:1.0:1767317537.908343:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cee00/0x73c3d5cb1442d01c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a719a6 expref: -99 pid: 81472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908361:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d023 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a719b4 expref: -99 pid: 81473 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908371:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d00e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71975 expref: -99 pid: 81471 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.908387:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ec8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.908412:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.908420:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c0700 x1853164291797888/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 512/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.908449:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797888:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.908591:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.921417:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291797888:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.921513:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767317537.921530:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.921568:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.921652:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff8c3c597df448) 00000008:00010000:1.0:1767317537.921698:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767317504 1767317504 1767317503 by oinfo size 4096 blocks 8 [cma]time 1767317504 1767317504 1767317505 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317537.921830:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.921857:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.922001:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.922011:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.922021:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.922045:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798016:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.922153:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.927352:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798016:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.927386:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927400:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927414:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927427:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927442:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927473:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927480:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.927493:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c437c3b80 x1853164291798016/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.927510:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927527:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.927535:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317537.927573:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317537.927581:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d95a 00000080:00010000:1.0:1767317537.927587:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.927590:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d95a from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317537.927593:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927602:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.927631:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.927646:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=8 00000080:00200008:1.0:1767317537.927662:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff8c3c61730908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317537.927669:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908),name=f212a.sanity-flr 00000002:00010000:1.0:1767317537.927708:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.927719:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.927732:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.927740:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.927744:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) 00000080:00010000:1.0:1767317537.927747:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff8c3c61730908) for lock 0x73c3d5cb1442d0ee 00000080:00010000:1.0:1767317537.927752:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d0ee from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317537.927755:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.927761:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.927815:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.927823:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.927842:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927850:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.927856:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.927860:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.927862:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d95a 00000080:00010000:1.0:1767317537.927866:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d95a from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317537.927910:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927918:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.927927:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317537.927936:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=0 00000080:00200000:1.0:1767317537.927941:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.927948:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.927954:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927961:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.927967:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317537.927970:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317537.927973:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d95a 00000080:00010000:1.0:1767317537.927976:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d95a from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317537.927979:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.927986:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317537.927993:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317537.927998:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317537.928029:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.928069:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767317537.928139:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767317537.928152:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767317537.928158:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3b80 x1853164291798272/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317537.928198:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798272:192.168.202.133@tcp:35:rm.0 00000100:00100000:1.0:1767317537.928328:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1767317537.934710:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798272:192.168.202.133@tcp:35:rm.0 00000002:00100000:1.0:1767317537.934772:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9c000 x1853164291681152/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 760/848 e 0 to 0 dl 1767317530 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767317537.934830:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.934868:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317537.934942:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767317537.934990:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.934997:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.935005:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.935038:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767317537.935042:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c821cea00/0x73c3d5cb1442d0f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71c62 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.935058:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d1c00/0x73c3d5cb1442d0ee lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a71c54 expref: -99 pid: 82062 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317537.935072:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d95a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73ef2 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317537.935095:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317537.935101:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c437c3b80 x1853164291798528/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 512/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317537.935139:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798528:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317537.935271:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684ab40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.952113:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c437c3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798528:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317537.952218:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317537.952234:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317537.952238:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317537.952247:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317537.952284:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317537.952293:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff8c3c61730908) 00000008:00010000:1.0:1767317537.952395:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 14 blocks 8 [cma]time: 1767317513 1767317513 0 by oinfo size 14 blocks 8 [cma]time 1767317513 1767317513 1767317513 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317537.952524:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317537.952549:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317537.952620:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.952629:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317537.952640:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317537.952677:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798656:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317537.952777:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4684a540 going to sleep for 12 seconds 00000100:00100000:1.0:1767317537.963547:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798656:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317537.963584:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.963601:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.963616:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.963630:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.963645:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.965985:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.965995:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317537.966019:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab2a00 x1853164291798656/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317537.966038:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317537.966055:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317537.966063:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.968092:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.968120:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d961 00000080:00010000:0.0:1767317537.968133:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.968136:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d961 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.968145:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968160:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.968219:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.968254:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=8 00000080:00200008:0.0:1767317537.968271:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff8c3c61732a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317537.968278:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08),name=f212b.sanity-flr 00000002:00010000:0.0:1767317537.968310:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.968327:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.968340:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.968348:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.968355:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) 00000080:00010000:0.0:1767317537.968358:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff8c3c61732a08) for lock 0x73c3d5cb1442d292 00000080:00010000:0.0:1767317537.968362:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d292 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317537.968365:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.968373:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.968424:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.968432:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.968438:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968447:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.968453:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.968461:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.968464:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d961 00000080:00010000:0.0:1767317537.968468:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d961 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317537.968472:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968479:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.968488:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.968495:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=0 00000080:00200000:0.0:1767317537.968500:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.968506:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.968512:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968519:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.968526:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317537.968529:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.968532:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d961 00000080:00010000:0.0:1767317537.968535:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d961 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317537.968538:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968545:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.968553:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317537.968564:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317537.968630:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.968664:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767317537.968728:0:83367:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767317537.968744:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767317537.968750:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42effb80 x1853164291798912/t0(0) o35->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767317537.968780:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798912:192.168.202.133@tcp:35:rm.0 00000100:00100000:0.0:1767317537.968989:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1767317537.972298:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291798912:192.168.202.133@tcp:35:rm.0 00000002:00100000:0.0:1767317537.972349:0:83367:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8c3c50e9dc00 x1853164291707904/t8589937322(8589937322) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 864/952 e 0 to 0 dl 1767317541 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767317537.972405:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317537.972439:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.972455:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317537.972462:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317537.972471:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767317537.972476:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.972562:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972569:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972574:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972579:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.972585:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.972589:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 5 locks packed 00010000:00010000:0.0:1767317537.972593:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d299 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72155 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972610:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d284 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72101 expref: -99 pid: 82651 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972619:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d292 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a72147 expref: -99 pid: 82655 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317537.972626:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c60c91000/0x73c3d5cb1442d26f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a720d0 expref: -99 pid: 82651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.972641:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f1c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317537.972674:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317537.972681:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42effb80 x1853164291799168/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 528/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317537.972705:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799168:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317537.972965:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.982081:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42effb80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799168:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317537.982417:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317537.982435:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317537.982438:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317537.982446:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767317537.982522:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317537.982532:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x90:0x0](ffff8c3c61732a08) 00000008:00010000:0.0:1767317537.982584:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767317522 1767317521 1767317521 by oinfo size 29 blocks 8 [cma]time 1767317522 1767317521 1767317521 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317537.982709:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317537.982738:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.983088:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.983098:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.983109:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.983183:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799296:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.983343:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317537.990973:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799296:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317537.991009:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991025:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991040:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991053:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991067:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991077:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991085:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317537.991098:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291799296/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317537.991116:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991152:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317537.991161:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317537.991208:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317537.991284:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d968 00000080:00010000:0.0:1767317537.991294:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317537.991297:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d968 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317537.991301:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317537.991310:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317537.991345:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317537.991373:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317537.991378:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317537.991409:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317537.991462:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.991470:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317537.991481:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317537.991510:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799424:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317537.991625:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.003657:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799424:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.003723:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003751:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003761:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003775:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003789:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003804:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.003822:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.004511:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.004532:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efd880 x1853164291799424/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767317554 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.004546:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.004581:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.004595:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/33 (0 0) 00000080:00200000:0.0:1767317538.004604:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.004654:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x21:0x0](ffff8c3c485163c8) 00000080:00200000:0.0:1767317538.005048:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x21:0x0], updating i_size 0 00000080:00200000:0.0:1767317538.005080:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x21:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317538.005088:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x21:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d96f 00000080:00010000:0.0:1767317538.005103:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x21:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317538.005107:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d96f from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.005111:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.005121:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.006617:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f2.sanity-flr:[0x200000402:0x21:0x0](ffff8c3c485163c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.006636:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x21:0x0](ffff8c3c485163c8),name=f2.sanity-flr 00000002:00010000:0.0:1767317538.009248:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x21:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.009283:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.009304:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.009314:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.009351:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x21:0x0](ffff8c3c485163c8) 00000080:00010000:0.0:1767317538.009357:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x21:0x0](ffff8c3c485163c8) for lock 0x73c3d5cb1442d96f 00000080:00010000:0.0:1767317538.009366:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d96f from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.009371:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.009380:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.009461:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.009475:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.009482:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009490:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.009496:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.009500:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.009502:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d968 00000080:00010000:0.0:1767317538.009507:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d968 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.009510:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009517:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.009526:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.009538:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.009550:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.009557:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.009563:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009570:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.009576:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.009580:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.009583:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d968 00000080:00010000:0.0:1767317538.009586:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d968 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.009590:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009596:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.009604:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.009610:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.009646:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009675:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.009687:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x21:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.009742:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 1/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.009765:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.009771:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.009774:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d96f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73f62 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.009797:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d968 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f46 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.009821:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.012839:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efd880 x1853164291799680/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.012915:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799680:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.013042:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.025768:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efd880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799680:192.168.202.133@tcp:36:rm.0 00000080:00200000:2.0:1767317538.035360:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x21:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767317538.035384:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x21:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767317538.035388:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767317538.035396:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:2.0:1767317538.035407:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x0 00000080:00200000:2.0:1767317538.035432:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x21:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767317538.035442:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x21:0x0](ffff8c3c485163c8) 00000080:00200000:2.0:1767317538.035589:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:2.0:1767317538.035618:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767317538.035701:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317538.035714:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:2.0:1767317538.035726:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:2.0:1767317538.035762:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799808:192.168.202.133@tcp:101:rm.0 00000100:00100000:2.0:1767317538.036026:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a09dc00 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.044943:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46a3b800 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799808:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.044982:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045000:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045015:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045061:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045077:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045087:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045094:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.045109:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46a3b800 x1853164291799808/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.045126:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045144:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.045151:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.045199:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.045207:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d976 00000080:00010000:0.0:1767317538.045215:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.045219:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d976 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.045222:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.045231:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.045271:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.045301:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.045307:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.045341:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f31.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.045398:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.045406:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.045416:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.045442:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799936:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.045561:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.050591:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291799936:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.050625:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050654:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050663:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050676:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050715:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050729:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050737:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.050744:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.050756:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efed80 x1853164291799936/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.050769:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.050784:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.050795:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/49 (0 0) 00000080:00200000:0.0:1767317538.050803:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317538.051486:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x31:0x0](ffff8c3c485e7448) 00000080:00200000:1.0:1767317538.051603:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x31:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767317538.051611:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x31:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d97d 00000080:00010000:1.0:1767317538.051625:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x31:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.051629:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d97d from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317538.051634:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.051645:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317538.051703:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f31.sanity-flr:[0x200000402:0x31:0x0](ffff8c3c485e7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317538.051713:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x31:0x0](ffff8c3c485e7448),name=f31.sanity-flr 00000002:00010000:1.0:1767317538.051748:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x31:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.051773:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.051786:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.051793:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.051799:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x31:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.051803:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x31:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d97d 00000080:00010000:1.0:1767317538.051807:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d97d from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317538.053684:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.053710:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.053751:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x31:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317538.053765:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x31:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317538.053768:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317538.053773:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x31:0x0] 00000008:00010000:1.0:1767317538.053803:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317538.053807:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c87b0, osc lock ffff8c3c60dd1c80, flags 0x400000400001002 00010000:00010000:1.0:1767317538.056637:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.056672:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.056701:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c46ab1f80 x1853164291800064/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767317538.056932:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767317538.057360:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291800064:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.060116:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060153:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060209:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060225:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767317538.060246:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767317538.060259:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767317538.060277:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060285:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060292:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.060301:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767317538.060323:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291800064:192.168.202.133@tcp:101:rm.0 00000080:00200000:1.0:1767317538.060689:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x31:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767317538.060697:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:1.0:1767317538.060701:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767317538.060708:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c87b0 (ffff8c3c547fd5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767317538.060713:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:1.0:1767317538.060716:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c87b0 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:1.0:1767317538.060734:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x31:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317538.060807:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.060860:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.060924:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.060940:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.060949:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.060959:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.060964:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d976 00000080:00010000:1.0:1767317538.060971:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d976 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317538.060975:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.060983:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.060994:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317538.061021:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f31.sanity-flr, flags=0 00000080:00200000:1.0:1767317538.061030:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.061037:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.061044:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.061053:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.061059:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.061062:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.061065:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d976 00000080:00010000:1.0:1767317538.061069:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d976 from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317538.061071:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.061078:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.061085:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317538.061092:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317538.061126:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.061158:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.061179:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x31:0x0]: losing layout lock 00010000:00010000:1.0:1767317538.061226:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.061243:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.061250:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317538.061253:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442d97d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73fa8 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.061276:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c629d0c00/0x73c3d5cb1442d976 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73f8c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317538.061300:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317538.061315:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46ab0000 x1853164291800320/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317538.061348:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800320:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317538.061476:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.065456:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800320:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317538.065542:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x31:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767317538.065557:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x31:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317538.065561:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317538.065569:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767317538.065602:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x31:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317538.065610:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x31:0x0](ffff8c3c485e7448) 00000008:00010000:1.0:1767317538.065662:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317538.065752:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.065798:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.065993:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.066003:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.066014:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.066041:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800448:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.066218:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.074412:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800448:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.074445:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074460:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074473:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074485:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074499:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074509:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074547:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.074560:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab2300 x1853164291800448/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.074576:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074592:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317538.074601:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317538.074644:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317538.074653:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d98b 00000080:00010000:1.0:1767317538.074661:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.074665:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d98b from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317538.074668:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.074677:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.074708:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317538.074736:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317538.074742:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317538.074772:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f33a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.074835:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.074855:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.074866:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.074944:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800576:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.075064:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.081510:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800576:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.081547:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081576:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081584:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081597:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081609:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081624:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081632:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.081664:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.081677:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab2300 x1853164291800576/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.081695:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317538.081711:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.081722:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/53 (0 0) 00000080:00200000:1.0:1767317538.081729:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317538.081769:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x35:0x0](ffff8c3c485e5348) 00000080:00200000:1.0:1767317538.081863:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x35:0x0], updating i_size 500 00000080:00200000:0.0:1767317538.086887:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x35:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767317538.086912:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x35:0x0](ffff8c3c485e5348) for lock 0x73c3d5cb1442d992 00000080:00010000:0.0:1767317538.086957:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x35:0x0](ffff8c3c485e5348) 00000080:00010000:0.0:1767317538.086961:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d992 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.086969:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.086984:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.087048:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f33a.sanity-flr:[0x200000402:0x35:0x0](ffff8c3c485e5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.087057:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x35:0x0](ffff8c3c485e5348),name=f33a.sanity-flr 00000002:00010000:0.0:1767317538.087089:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.087106:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.087119:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.087127:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.087134:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x35:0x0](ffff8c3c485e5348) 00000080:00010000:0.0:1767317538.087137:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x35:0x0](ffff8c3c485e5348) for lock 0x73c3d5cb1442d992 00000080:00010000:0.0:1767317538.087141:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d992 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.087144:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.087152:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.087217:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.087224:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.087237:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087245:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.087252:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.087256:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.087258:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d98b 00000080:00010000:0.0:1767317538.087262:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d98b from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.087264:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087271:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.087280:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.087291:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f33a.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.087296:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.087301:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.087305:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087312:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.087318:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.087321:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.087323:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d98b 00000080:00010000:0.0:1767317538.087325:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d98b from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.087335:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087342:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.087349:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.087354:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.087378:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087403:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.087412:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x35:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.087454:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.087462:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.087468:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.087470:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a73ff5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.087491:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d98b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a73fd9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.087512:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.087527:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42eff480 x1853164291800832/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.087566:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800832:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.087697:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.105315:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42eff480 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800832:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.105396:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x35:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.105411:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x35:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.105414:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.105421:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767317538.105457:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x35:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.105466:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x35:0x0](ffff8c3c485e5348) 00000080:00200000:0.0:1767317538.105592:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.105621:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.105697:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.105709:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.105720:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.105746:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800960:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.107522:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.127982:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291800960:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.128021:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128036:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128081:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128093:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128107:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128117:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128124:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.128137:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291800960/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.128153:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128177:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.128186:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.128222:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.128228:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d999 00000080:00010000:0.0:1767317538.128234:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.128238:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d999 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.128241:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.128254:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.128282:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.128307:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.128312:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.128344:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f35.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.128401:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.128409:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.128419:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.128445:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801088:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.129700:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.134852:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801088:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.135029:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135059:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135077:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135119:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135133:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135147:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135156:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.135164:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.135184:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291801088/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/848 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.135197:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.135213:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.135224:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/255 (0 0) 00000080:00200000:0.0:1767317538.135232:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.135271:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0xff:0x0](ffff8c3c485100c8) 00000080:00200000:0.0:1767317538.135379:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0xff:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767317538.135386:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0xff:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9a0 00000080:00010000:0.0:1767317538.135405:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xff:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.135409:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9a0 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.135412:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.135422:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.135469:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f35.sanity-flr:[0x200000402:0xff:0x0](ffff8c3c485100c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.135477:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xff:0x0](ffff8c3c485100c8),name=f35.sanity-flr 00000002:00010000:0.0:1767317538.135508:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xff:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.135517:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.135529:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.135535:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.135539:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xff:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.135542:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0xff:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9a0 00000080:00010000:0.0:1767317538.135546:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9a0 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.135549:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.135556:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.135574:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0xff:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.135585:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0xff:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.135593:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317538.135598:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0xff:0x0] 00000008:00010000:0.0:1767317538.135617:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317538.135621:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d2879b0, osc lock ffff8c3c50c8ee40, flags 0x400000400001002 00010000:00010000:0.0:1767317538.135676:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.135685:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.135696:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c42efce00 x1853164291801216/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317538.135796:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291801216:192.168.202.133@tcp:101:rm.0 00000020:00200000:0.0:1767317538.136561:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317538.139522:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139559:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139577:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139594:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317538.139636:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 100, setting rss=100; kms=100, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317538.139649:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317538.139671:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139680:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139687:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.139696:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317538.139718:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291801216:192.168.202.133@tcp:101:rm.0 00000080:00200000:0.0:1767317538.139997:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0xff:0x0] updating i_size 100 i_blocks 0 00000020:00010000:0.0:1767317538.140007:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:0.0:1767317538.140011:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.140017:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d2879b0 (ffff8c3c547fda28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.140021:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317538.140024:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d2879b0 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317538.140040:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0xff:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.140253:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.140289:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.140308:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140322:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.140330:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.140350:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.140354:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d999 00000080:00010000:0.0:1767317538.140363:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d999 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.140367:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140373:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.140384:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.140396:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f35.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.140402:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.140409:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.140414:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140422:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.140428:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.140432:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.140434:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d999 00000080:00010000:0.0:1767317538.140438:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d999 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.140441:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140447:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.140454:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.140466:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.140498:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140525:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.140535:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0xff:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.140578:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.140585:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.140591:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.140594:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a7403b expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.140616:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7401f expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.140637:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.140648:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efdc00 x1853164291801472/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.140677:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801472:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.140802:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.170145:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efdc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801472:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.170239:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0xff:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767317538.170254:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0xff:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.170278:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.170287:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317538.170322:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0xff:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.170331:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0xff:0x0](ffff8c3c485100c8) 00000008:00010000:0.0:1767317538.170374:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 100 blocks 0 [cma]time: 1767316191 1767316191 1767316190 by oinfo size 100 blocks 0 [cma]time 1767316191 1767316191 1767316190 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317538.170490:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.170516:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.170589:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.170598:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.170608:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.170633:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801600:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.170759:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.178061:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801600:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.178097:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178114:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178129:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178180:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178195:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178204:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178214:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.178226:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291801600/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.178243:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178261:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.178270:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.178308:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.178316:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9ae 00000080:00010000:0.0:1767317538.178322:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.178326:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ae from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.178329:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.178338:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.178376:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.178400:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.178405:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.178436:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f36b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.178490:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.178498:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.178508:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.178531:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801728:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.178649:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.181697:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291801728:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.181729:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181756:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x108:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181766:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181779:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181810:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181835:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181844:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.181852:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.181866:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291801728/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.181908:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.181923:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.181935:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/264 (0 0) 00000080:00200000:0.0:1767317538.181943:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.181987:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x108:0x0](ffff8c3c485100c8) 00000080:00200000:0.0:1767317538.182089:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x108:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:0.0:1767317538.182096:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x108:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9b5 00000080:00010000:0.0:1767317538.182109:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x108:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.182113:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9b5 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.182123:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.182131:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.182187:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f36b.sanity-flr:[0x200000402:0x108:0x0](ffff8c3c485100c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.182196:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x108:0x0](ffff8c3c485100c8),name=f36b.sanity-flr 00000002:00010000:0.0:1767317538.182223:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x108:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.182233:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.182244:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.182250:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.182255:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x108:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.182258:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x108:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9b5 00000080:00010000:0.0:1767317538.182262:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9b5 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.182265:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.182272:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.182293:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x108:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.182306:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x108:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.182309:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317538.182323:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x108:0x0] 00000008:00010000:0.0:1767317538.182346:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317538.182350:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d2879b0, osc lock ffff8c3c50c8ee40, flags 0x400000400001002 00010000:00010000:0.0:1767317538.182409:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.182419:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.182430:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c42efce00 x1853164291801856/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317538.182527:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291801856:192.168.202.133@tcp:101:rm.0 00000020:00200000:0.0:1767317538.183142:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317538.189266:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189301:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189347:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189362:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317538.189381:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1048576, setting rss=1048576; kms=1048576, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317538.189395:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317538.189421:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189431:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189440:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.189449:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317538.189474:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291801856:192.168.202.133@tcp:101:rm.0 00000080:00200000:0.0:1767317538.189618:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x108:0x0] updating i_size 1048576 i_blocks 2048 00000020:00010000:0.0:1767317538.189627:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:0.0:1767317538.189631:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.189637:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d2879b0 (ffff8c3c547fda28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.189642:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317538.189645:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d2879b0 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317538.189664:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x108:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.189728:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.189758:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.189777:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.189791:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.189799:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.189807:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.189832:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9ae 00000080:00010000:0.0:1767317538.189840:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ae from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.189844:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.189851:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.189863:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.189911:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f36b.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.189919:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.189928:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.189934:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.189942:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.189948:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.189953:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.189955:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9ae 00000080:00010000:0.0:1767317538.189959:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ae from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.189962:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.189969:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.189977:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.189990:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.190026:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.190054:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.190065:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x108:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.190111:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.190119:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.190125:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.190127:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74088 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.190149:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7406c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.190182:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.190194:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efed80 x1853164291802112/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.190226:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802112:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.190431:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.197375:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efed80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802112:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.197457:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x108:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767317538.197471:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x108:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.197491:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.197499:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317538.197533:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x108:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.197541:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x108:0x0](ffff8c3c485100c8) 00000008:00010000:0.0:1767317538.197582:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1048576 blocks 2048 [cma]time: 1767316210 1767316210 0 by oinfo size 1048576 blocks 2048 [cma]time 1767316210 1767316210 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317538.197685:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.197712:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.197793:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.197802:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.197826:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.197855:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802240:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.198033:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.202541:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802240:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.202576:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202591:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202605:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202642:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202656:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202664:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202671:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.202682:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291802240/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.202697:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202713:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.202721:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.202759:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.202768:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9c3 00000080:00010000:0.0:1767317538.202775:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.202778:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9c3 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.202781:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.202790:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.202841:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.202922:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.202929:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.202959:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f36d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.203014:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.203022:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.203031:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.203054:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802368:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.203183:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.209690:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802368:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.209726:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209762:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209772:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209786:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209828:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209843:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209852:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.209860:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.209925:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c42efce00 x1853164291802368/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/928 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.209942:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.209959:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.209972:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/269 (0 0) 00000080:00200000:0.0:1767317538.209980:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.210019:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x10d:0x0](ffff8c3c485100c8) 00000080:00200000:0.0:1767317538.210127:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x10d:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:0.0:1767317538.210135:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10d:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9ca 00000080:00010000:0.0:1767317538.210148:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10d:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.210152:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ca from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.210178:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.210188:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.210237:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f36d.sanity-flr:[0x200000402:0x10d:0x0](ffff8c3c485100c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.210245:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x10d:0x0](ffff8c3c485100c8),name=f36d.sanity-flr 00000002:00010000:0.0:1767317538.210274:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x10d:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.210283:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.210295:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.210301:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.210306:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10d:0x0](ffff8c3c485100c8) 00000080:00010000:0.0:1767317538.210309:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10d:0x0](ffff8c3c485100c8) for lock 0x73c3d5cb1442d9ca 00000080:00010000:0.0:1767317538.210313:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ca from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.210316:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.210323:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.210341:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x10d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.210353:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x10d:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317538.210356:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317538.210367:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x10d:0x0] 00000008:00010000:0.0:1767317538.210385:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317538.210389:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287930, osc lock ffff8c3c50c8ee40, flags 0x400000400001002 00010000:00010000:0.0:1767317538.210445:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.210453:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.210463:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c42efce00 x1853164291802496/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767317538.210501:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767317538.210701:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291802496:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.220963:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221000:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221019:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221035:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317538.221057:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1024, setting rss=1024; kms=1024, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317538.221072:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317538.221095:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221104:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221112:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.221122:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317538.221182:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291802496:192.168.202.133@tcp:101:rm.0 00000080:00200000:0.0:1767317538.226414:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x10d:0x0] updating i_size 1024 i_blocks 8 00000020:00010000:0.0:1767317538.226432:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_release():245 00000020:00010000:0.0:1767317538.226437:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.226443:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287930 (ffff8c3c547fda28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.226450:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b11b60 (ffff8c3c547fd638/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317538.226454:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287930 (ffff8c3c547fd638/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317538.226475:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x10d:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.226551:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.226583:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.226603:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226621:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.226629:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.226637:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.226658:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9c3 00000080:00010000:0.0:1767317538.226667:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9c3 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.226672:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226682:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.226700:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.226712:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f36d.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.226717:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.226722:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.226727:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226734:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.226741:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.226744:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.226746:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9c3 00000080:00010000:0.0:1767317538.226749:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9c3 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.226751:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226758:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.226766:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.226777:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.226810:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226843:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.226853:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x10d:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.226949:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 1/0,0 mode: --/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.226958:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.226964:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.226967:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442d9ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a740d5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.226988:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a740b9 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.227009:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.227024:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c42efce00 x1853164291802752/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.227053:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802752:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.227179:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.232163:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c42efce00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802752:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317538.232296:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x10d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317538.232314:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x10d:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317538.232317:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317538.232327:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767317538.232364:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x10d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317538.232373:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x10d:0x0](ffff8c3c485100c8) 00000008:00010000:1.0:1767317538.232418:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1024 blocks 8 [cma]time: 1767316228 1767316228 1767316225 by oinfo size 1024 blocks 8 [cma]time 1767316228 1767316228 1767316225 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767317538.232533:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.232630:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.232719:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.232728:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.232740:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.232768:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802880:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.232926:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.236321:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291802880:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.236354:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236388:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236404:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236418:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236432:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236440:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236449:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.236463:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab0700 x1853164291802880/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.236479:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236494:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317538.236503:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317538.236539:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317538.236547:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9d8 00000080:00010000:1.0:1767317538.236554:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.236566:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9d8 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317538.236571:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.236579:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.236609:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317538.236638:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317538.236644:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317538.236687:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f49a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.236742:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.236751:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.236761:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.236790:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803008:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.237461:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.247155:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803008:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.247198:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247224:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247234:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247265:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247278:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247293:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247301:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247309:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.247323:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab0700 x1853164291803008/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/824 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.247337:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317538.247353:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.247366:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/14 (0 0) 00000080:00200000:1.0:1767317538.247374:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317538.247423:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe:0x0](ffff8c3c485e7448) 00000080:00200000:1.0:1767317538.247507:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xe:0x0], updating i_size 1048576 00000080:00200000:1.0:1767317538.247533:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0xe:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:1.0:1767317538.247546:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d9df 00000080:00010000:1.0:1767317538.247561:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.247566:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9df from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317538.247569:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.247579:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317538.247629:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f49a.sanity-flr:[0x200000405:0xe:0x0](ffff8c3c485e7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317538.247639:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff8c3c485e7448),name=f49a.sanity-flr 00000002:00010000:1.0:1767317538.247669:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.247679:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.247692:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.247699:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.247703:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.247706:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d9df 00000080:00010000:1.0:1767317538.247711:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9df from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317538.247714:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.247722:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.247779:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.247792:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.247799:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247807:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.247814:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.247817:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.247820:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9d8 00000080:00010000:1.0:1767317538.247823:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9d8 from it ffffa7f7c1c1fc10 00010000:00010000:1.0:1767317538.247826:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.247834:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.247842:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317538.247984:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f49a.sanity-flr, flags=0 00000080:00200000:1.0:1767317538.247990:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.247999:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.248006:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.248014:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.248020:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.248024:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.248027:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9d8 00000080:00010000:1.0:1767317538.248036:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9d8 from it ffffa7f7c1c1fd68 00010000:00010000:1.0:1767317538.248039:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.248047:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.248055:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767317538.248061:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:1.0:1767317538.248086:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.248112:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.248121:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0xe:0x0]: losing layout lock 00010000:00010000:1.0:1767317538.248158:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.248176:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.248182:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767317538.248185:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9df lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74122 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.248206:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a74106 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767317538.248225:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767317538.248235:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c46ab0700 x1853164291803264/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317538.248270:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803264:192.168.202.133@tcp:36:rm.0 00000100:00100000:1.0:1767317538.248388:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.266358:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803264:192.168.202.133@tcp:36:rm.0 00000080:00200000:1.0:1767317538.266443:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767317538.266458:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0xe:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767317538.266461:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767317538.266469:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767317538.266508:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767317538.266517:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe:0x0](ffff8c3c485e7448) 00000080:00200000:1.0:1767317538.266656:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:1.0:1767317538.266682:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.267326:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.267340:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.267352:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.267380:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803392:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.267513:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.283531:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803392:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.283565:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283578:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283612:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283626:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283641:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283650:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283670:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.283684:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab3b80 x1853164291803392/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.283701:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283716:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767317538.283725:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767317538.283764:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767317538.283772:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9e6 00000080:00010000:1.0:1767317538.283778:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:1.0:1767317538.283781:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9e6 from it ffffa7f7c1c1fb58 00010000:00010000:1.0:1767317538.283785:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.283802:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767317538.283846:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767317538.283912:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:1.0:1767317538.283917:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:1.0:1767317538.283947:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.284000:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.284007:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:1.0:1767317538.284017:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:1.0:1767317538.284041:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803520:192.168.202.133@tcp:101:rm.0 00000100:00100000:1.0:1767317538.284152:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c5073a300 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.304011:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803520:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.304049:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304084:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304093:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304132:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304145:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304160:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304180:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767317538.304189:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767317538.304201:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c46ab3b80 x1853164291803520/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/928 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767317538.304215:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767317538.304232:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.304243:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/39 (0 0) 00000080:00200000:1.0:1767317538.304251:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767317538.304288:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x27:0x0](ffff8c3c485e7448) 00000080:00200000:1.0:1767317538.304391:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x27:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1767317538.304397:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x27:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d9ed 00000080:00010000:1.0:1767317538.304416:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x27:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.304419:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ed from it ffffa7f7c1c1fb20 00010000:00010000:1.0:1767317538.304422:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.304431:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767317538.304477:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f5.sanity-flr:[0x200000402:0x27:0x0](ffff8c3c485e7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767317538.304485:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x27:0x0](ffff8c3c485e7448),name=f5.sanity-flr 00000002:00010000:1.0:1767317538.304511:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x27:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767317538.304519:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.304531:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.304537:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767317538.304542:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x27:0x0](ffff8c3c485e7448) 00000080:00010000:1.0:1767317538.304545:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x27:0x0](ffff8c3c485e7448) for lock 0x73c3d5cb1442d9ed 00000080:00010000:1.0:1767317538.304548:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9ed from it ffffa7f7c1c1fcb8 00010000:00010000:1.0:1767317538.304551:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767317538.304559:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767317538.304577:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x27:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767317538.304590:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x27:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767317538.304598:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767317538.304603:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x27:0x0] 00000008:00010000:1.0:1767317538.304624:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767317538.304628:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c468c8430, osc lock ffff8c3c60dd1c80, flags 0x400000400001002 00010000:00010000:1.0:1767317538.304683:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.304692:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.304702:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c46ab3b80 x1853164291803648/t0(0) o101->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767317538.304783:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767317538.304803:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317538.304829:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291803648:192.168.202.133@tcp:101:rm.0 00010000:00010000:1.0:1767317538.312271:0:2518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312311:0:2518:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312330:0:2518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312347:0:2518:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317538.312368:0:2518:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 12345, setting rss=12345; kms=12345, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317538.312406:0:2518:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317538.312429:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312438:0:2518:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312445:0:2518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.312453:0:2518:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317538.312478:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291803648:192.168.202.133@tcp:101:rm.0 00000080:00200000:0.0:1767317538.312556:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x27:0x0] updating i_size 12345 i_blocks 0 00000020:00010000:0.0:1767317538.312570:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317538.312583:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.312590:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c468c8430 (ffff8c3c547fd998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.312596:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317538.312599:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c468c8430 (ffff8c3c547fd5a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317538.312615:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x27:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.312690:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.312731:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.312757:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.312773:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.312782:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.312792:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.312798:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9e6 00000080:00010000:0.0:1767317538.312806:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9e6 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.312821:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.312830:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.312844:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.312860:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.312867:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.312922:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.312929:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.312945:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.312951:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.312956:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.312959:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9e6 00000080:00010000:0.0:1767317538.312963:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9e6 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.312966:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.312973:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.312981:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.312987:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.313024:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.313058:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.313070:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x27:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.313123:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 1/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.313131:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.313137:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.313146:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1c00/0x73c3d5cb1442d9ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a74168 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.313181:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c43af1000/0x73c3d5cb1442d9e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a7414c expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.313205:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.313217:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9dc00 x1853164291803904/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.313250:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803904:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.313469:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.331779:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291803904:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.332128:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x27:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767317538.332146:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x27:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767317538.332150:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.332157:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767317538.332206:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x27:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.332217:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x27:0x0](ffff8c3c485e7448) 00000008:00010000:0.0:1767317538.332259:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 12345 blocks 0 [cma]time: 0 0 0 by oinfo size 12345 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767317538.332381:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.332409:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.332478:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.332488:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.332528:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.332554:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804032:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.332720:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.338154:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291804288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317538.338315:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317538.338335:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291804160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317538.338371:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291804416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317538.356346:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804032:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.356384:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356400:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356414:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356427:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356441:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356450:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356481:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.356495:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9c000 x1853164291804032/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.356512:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356527:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.356535:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.356572:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.356580:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9fb 00000080:00010000:0.0:1767317538.356585:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.356589:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9fb from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.356593:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.356601:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.356631:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.356656:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.356661:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.356694:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f72.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.356753:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.356773:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.356784:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.356831:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804544:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.356981:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:1.0:1767317538.359009:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291804160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317538.359057:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291804416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317538.359073:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291804288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317538.366348:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804544:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.366385:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366412:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366420:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366435:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366447:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366461:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366482:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.366511:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.366526:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9c000 x1853164291804544/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1344 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.366548:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 760 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.366562:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.366575:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935621/87 (0 0) 00000080:00200000:0.0:1767317538.366584:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.366632:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x57:0x0](ffff8c3c48515b88) 00000080:00200000:0.0:1767317538.366783:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x57:0x0], updating i_size 3145728 00000080:00200000:0.0:1767317538.366816:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x57:0x0]: layout version change: 4294967294 -> 15 00000080:00010000:0.0:1767317538.366823:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x57:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442da02 00000080:00010000:0.0:1767317538.366837:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x57:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317538.366841:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da02 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.366845:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.366855:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.366974:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f72.sanity-flr:[0x200000405:0x57:0x0](ffff8c3c48515b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.366983:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x57:0x0](ffff8c3c48515b88),name=f72.sanity-flr 00000002:00010000:0.0:1767317538.367018:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x57:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.367029:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.367040:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.367047:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.367052:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x57:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317538.367056:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x57:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442da02 00000080:00010000:0.0:1767317538.367060:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da02 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.367063:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.367070:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.367125:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.367133:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.367139:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367147:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.367154:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.367158:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.367161:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9fb 00000080:00010000:0.0:1767317538.367175:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9fb from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.367184:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367190:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.367198:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.367208:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f72.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.367213:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.367219:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.367224:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367231:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.367237:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.367240:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.367242:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442d9fb 00000080:00010000:0.0:1767317538.367245:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442d9fb from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.367248:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367254:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.367260:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.367265:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.367289:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367330:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.367340:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x57:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.367378:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.367386:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.367391:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.367394:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da02 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a741b5 expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.367412:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442d9fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a74199 expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.367434:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.367445:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c000 x1853164291804800/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.367472:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804800:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.367572:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178900 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.386498:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804800:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.386585:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x57:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.386602:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x57:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.386606:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.386636:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767317538.386649:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00020000:00200000:0.0:1767317538.386654:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:0.0:1767317538.386659:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x0 00000080:00200000:0.0:1767317538.386685:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x57:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.386694:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x57:0x0](ffff8c3c48515b88) 00000080:00200000:0.0:1767317538.386957:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.386986:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.387060:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.387072:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.387083:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.387108:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804928:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.387215:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178e40 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.390637:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291804928:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.390674:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390690:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390707:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390721:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390761:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390769:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390777:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.390788:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d880 x1853164291804928/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.390804:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.390822:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767317538.390837:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767317538.391255:0:83367:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767317538.391266:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442da09 00000080:00010000:0.0:1767317538.391274:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.391278:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da09 from it ffffa7f7c1c1fb58 00010000:00010000:0.0:1767317538.391283:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.391292:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.391325:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.391357:0:83367:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), flags=8 00000080:00200000:0.0:1767317538.391362:0:83367:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8), intent=getattr 00000002:00010000:0.0:1767317538.391392:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.391448:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.391457:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00010000:00010000:0.0:1767317538.391724:0:83367:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83367 initiator: MDT0 00000100:00100000:0.0:1767317538.391754:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291805056:192.168.202.133@tcp:101:rm.0 00000100:00100000:0.0:1767317538.392577:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.397778:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291805056:192.168.202.133@tcp:101:rm.0 00010000:00010000:0.0:1767317538.397812:0:83367:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398012:0:83367:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398022:0:83367:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398037:0:83367:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398051:0:83367:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398090:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398099:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.398106:0:83367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767317538.398119:0:83367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8c3c50e9d880 x1853164291805056/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 584/1008 e 0 to 0 dl 1767317555 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767317538.398132:0:83367:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 424 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767317538.398144:0:83367:0:(mdc_locks.c:969:mdc_finish_enqueue()) ### DoM lock is returned by: getattr, size: 0 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767317538.398156:0:83367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.398181:0:83367:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff8c3c44f18800 type 13 mode 4 res 8589935618/41 (0 0) 00000080:00200000:0.0:1767317538.398189:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767317538.398229:0:83367:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x29:0x0](ffff8c3c48515b88) 00000080:00200000:0.0:1767317538.398343:0:83367:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x29:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1767317538.398350:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x29:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442da10 00000080:00010000:0.0:1767317538.398362:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x29:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317538.398366:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da10 from it ffffa7f7c1c1fb20 00010000:00010000:0.0:1767317538.398377:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.398387:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767317538.398442:0:83367:0:(file.c:6252:ll_getattr_dentry()) START file f7.sanity-flr:[0x200000402:0x29:0x0](ffff8c3c48515b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317538.398451:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x29:0x0](ffff8c3c48515b88),name=f7.sanity-flr 00000002:00010000:0.0:1767317538.398801:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x29:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.398813:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.399383:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.399398:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.399407:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x29:0x0](ffff8c3c48515b88) 00000080:00010000:0.0:1767317538.399411:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x29:0x0](ffff8c3c48515b88) for lock 0x73c3d5cb1442da10 00000080:00010000:0.0:1767317538.399418:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da10 from it ffffa7f7c1c1fcb8 00010000:00010000:0.0:1767317538.399422:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.399432:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.399458:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x29:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.399553:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x29:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.399557:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767317538.399562:0:83367:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x29:0x0] 00000008:00010000:0.0:1767317538.399596:0:83367:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767317538.399601:0:83367:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff8c3c6d287430, osc lock ffff8c3c50c8ee40, flags 0x400000400001002 00010000:00010000:0.0:1767317538.400175:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.400187:0:83367:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.400203:0:83367:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff8c3c50e9d880 x1853164291805184/t0(0) o101->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767317538.400294:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805184:192.168.202.133@tcp:101:rm.0 00000020:00200000:0.0:1767317538.400484:0:83367:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767317538.413456:0:2517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.413568:0:2517:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.414110:0:2517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.414130:0:2517:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767317538.414149:0:2517:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x10020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767317538.414175:0:2517:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767317538.414246:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.414257:0:2517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.414265:0:2517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317538.414274:0:2517:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767317538.414299:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805184:192.168.202.133@tcp:101:rm.0 00000080:00200000:0.0:1767317538.419108:0:83367:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x29:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1767317538.419127:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_release():245 00000020:00010000:0.0:1767317538.419134:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.419140:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8c3c6d287430 (ffff8c3c547fda28/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767317538.419147:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c62b136c0 (ffff8c3c547fd5a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767317538.419151:0:83367:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8c3c6d287430 (ffff8c3c547fd5a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767317538.419186:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x29:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.419258:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.419290:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.419316:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.419334:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.419344:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.419354:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.419359:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442da09 00000080:00010000:0.0:1767317538.419390:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da09 from it ffffa7f7c1c1fc10 00010000:00010000:0.0:1767317538.419395:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.419404:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.419422:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767317538.419435:0:83367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f7.sanity-flr, flags=0 00000080:00200000:0.0:1767317538.419441:0:83367:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317538.419449:0:83367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317538.419455:0:83367:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.419717:0:83367:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.419728:0:83367:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767317538.419734:0:83367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) 00000080:00010000:0.0:1767317538.419736:0:83367:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8c3c485b63c8) for lock 0x73c3d5cb1442da09 00000080:00010000:0.0:1767317538.419741:0:83367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x73c3d5cb1442da09 from it ffffa7f7c1c1fd68 00010000:00010000:0.0:1767317538.419744:0:83367:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.419751:0:83367:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767317538.419759:0:83367:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767317538.419765:0:83367:0:(namei.c:2354:ll_unlink()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff8c3c485b63c8) 00010000:00010000:0.0:1767317538.419815:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.421077:0:83367:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767317538.421116:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x29:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:0.0:1767317538.421128:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x29:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.421140:0:83367:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x29:0x0]: losing layout lock 00010000:00010000:0.0:1767317538.421209:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.421218:0:83367:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767317538.421224:0:83367:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767317538.421227:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccce00/0x73c3d5cb1442da10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x541306ba06a741fb expref: -99 pid: 83367 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767317538.421252:0:83367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccd400/0x73c3d5cb1442da09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x541306ba06a741df expref: -99 pid: 83367 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767317538.421275:0:83367:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8c3c49ba6000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767317538.421291:0:83367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c3c50e9c380 x1853164291805440/t0(0) o36->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317538.421321:0:83367:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291805440:192.168.202.133@tcp:36:rm.0 00000100:00100000:0.0:1767317538.421440:0:83367:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c4a178600 going to sleep for 12 seconds 00000100:00100000:0.0:1767317538.433572:0:83367:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job rm:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:83367:1853164291805440:192.168.202.133@tcp:36:rm.0 00000080:00200000:0.0:1767317538.433675:0:83367:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x29:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767317538.433691:0:83367:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x29:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767317538.433695:0:83367:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767317538.433703:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767317538.433714:0:83367:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1767317538.433741:0:83367:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x29:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767317538.433751:0:83367:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x29:0x0](ffff8c3c48515b88) 00000008:00010000:0.0:1767317538.433795:0:83367:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317538.658189:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317539.501507:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317539.501557:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379251968 00000100:00100000:2.0:1767317539.501570:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379251968 00000100:00100000:2.0:1767317539.501620:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9534 00000100:00100000:2.0:1767317539.501630:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18380:x1853164379251968:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317539.501648:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317539.501739:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317539.501747:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18380:x1853164379251968:12345-192.168.202.133@tcp:104: Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317539.501754:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9534 00010000:00010000:1.0:1767317539.501823:0:60279:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317539.501831:0:60279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.501846:0:60279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317539.501853:0:60279:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.501924:0:60279:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.501932:0:60279:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317539.501955:0:60279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.501963:0:60279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1600/0x73c3d5cb1442d5b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df0 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.501982:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317539.501984:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317539.501986:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317539.502002:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291805568:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317539.530084:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317539.530139:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379253504 00000100:00100000:2.0:1767317539.530149:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379253504 00000100:00100000:2.0:1767317539.530211:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9535 00000100:00100000:2.0:1767317539.530221:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:18378:x1853164379253504:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317539.530239:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317539.530410:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317539.530417:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:18378:x1853164379253504:12345-192.168.202.133@tcp:104: Request processed in 197us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317539.530425:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9535 00010000:00010000:1.0:1767317539.531232:0:64002:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317539.531241:0:64002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.531252:0:64002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317539.531259:0:64002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.531424:0:64002:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.531432:0:64002:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317539.531452:0:64002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.531461:0:64002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc200/0x73c3d5cb1442d619 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72fc5 expref: -99 pid: 83377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317539.531479:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317539.531481:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317539.531483:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317539.531501:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805696:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317539.531627:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291805568:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317539.541220:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805696:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317539.681275:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317540.705731:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317541.118474:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.118822:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379257216 00000100:00100000:3.0:1767317541.118834:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379257216 00000100:00100000:3.0:1767317541.118908:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9536 00000100:00100000:3.0:1767317541.118919:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379257216:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.118937:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.119215:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317541.119223:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19256:x1853164379257216:12345-192.168.202.133@tcp:104: Request processed in 306us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.119232:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9536 00010000:00010000:1.0:1767317541.120762:0:50308:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317541.120776:0:50308:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.120789:0:50308:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0400 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317541.120796:0:50308:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.121396:0:50308:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.121404:0:50308:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317541.121434:0:50308:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.121443:0:50308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0400/0x73c3d5cb1442d5b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a72df7 expref: -99 pid: 83375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.121461:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.121464:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.121466:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317541.121492:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291805824:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317541.133559:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317541.134090:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379259904 00000100:00100000:2.0:1767317541.134101:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379259904 00000100:00100000:2.0:1767317541.134158:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9537 00000100:00100000:2.0:1767317541.134168:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18380:x1853164379259904:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317541.134186:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317541.134268:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317541.134289:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c46a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18380:x1853164379259904:12345-192.168.202.133@tcp:104: Request processed in 122us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317541.134297:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9537 00010000:00010000:1.0:1767317541.134372:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317541.134380:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.134389:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317541.134395:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.134441:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.134448:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317541.134477:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.134486:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd000/0x73c3d5cb1442d8dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73cbb expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.134507:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.134509:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.134511:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317541.134526:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805952:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317541.140178:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317541.140232:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317541.140276:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767317541.140294:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379261056 00000100:00100000:2.0:1767317541.140304:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379261056 00000100:00100000:2.0:1767317541.140354:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9538 00000100:00100000:2.0:1767317541.140364:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:48334:x1853164379261056:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317541.140382:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317541.140497:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317541.140505:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:48334:x1853164379261056:12345-192.168.202.133@tcp:104: Request processed in 142us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317541.140512:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9538 00000100:00100000:1.0:1767317541.140683:0:42089:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379261312 00000100:00100000:1.0:1767317541.140687:0:42089:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379261312 00000100:00100000:1.0:1767317541.140717:0:42089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 410 00000100:00100000:1.0:1767317541.140724:0:42089:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c5a288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:48789:x1853164379261312:12345-192.168.202.133@tcp:104: 00010000:00010000:1.0:1767317541.140735:0:42089:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143071:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767317541.143087:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143101:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.143109:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143178:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143185:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.143216:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143224:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc800/0x73c3d5cb1442d8f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d08 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143259:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317541.143263:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143270:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccdc00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.143273:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143294:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143300:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.143307:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143313:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccdc00/0x73c3d5cb1442d8f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73d0f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.143325:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.143327:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.143329:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.143440:0:42089:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1767317541.143456:0:42089:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c5a288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:48789:x1853164379261312:12345-192.168.202.133@tcp:104: Request processed in 2727us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1767317541.143467:0:42089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 410 00000100:00100000:1.0:1767317541.143517:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806080:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317541.143641:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317541.143649:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806208:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767317541.146833:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317541.148600:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806208:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.148619:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806080:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.148638:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291805824:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317541.148955:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291805952:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317541.163791:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163827:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163847:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163902:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163922:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163952:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.163978:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379262592 00000100:00100000:3.0:1767317541.163988:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379262592 00000100:00100000:3.0:1767317541.164022:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379262976 00000100:00100000:3.0:1767317541.164025:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379262976 00000100:00100000:3.0:1767317541.164032:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379263104 00000100:00100000:3.0:1767317541.164034:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379263104 00000100:00100000:3.0:1767317541.164041:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379263744 00000100:00100000:3.0:1767317541.164042:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379263744 00000100:00100000:3.0:1767317541.164051:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379264128 00000100:00100000:3.0:1767317541.164053:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379264128 00000100:00100000:3.0:1767317541.164060:0:42091:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379264512 00000100:00100000:3.0:1767317541.164062:0:42091:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379264512 00000100:00100000:3.0:1767317541.164075:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9539 00000100:00100000:3.0:1767317541.164084:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:19290:x1853164379262592:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164101:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164184:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317541.164192:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:19290:x1853164379262592:12345-192.168.202.133@tcp:104: Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164199:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9539 00000100:00100000:3.0:1767317541.164219:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9540 00000100:00100000:3.0:1767317541.164225:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:18380:x1853164379262976:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164233:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164271:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1767317541.164277:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:18380:x1853164379262976:12345-192.168.202.133@tcp:104: Request processed in 52us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164292:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9540 00000100:00100000:3.0:1767317541.164307:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9541 00000100:00100000:3.0:1767317541.164313:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48789:x1853164379263104:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164322:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164352:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1767317541.164357:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48789:x1853164379263104:12345-192.168.202.133@tcp:104: Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164362:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9541 00000100:00100000:3.0:1767317541.164374:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9542 00000100:00100000:3.0:1767317541.164380:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:19256:x1853164379263744:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164388:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164414:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1767317541.164419:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:19256:x1853164379263744:12345-192.168.202.133@tcp:104: Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164424:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9542 00000100:00100000:3.0:1767317541.164435:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9543 00000100:00100000:3.0:1767317541.164440:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:18379:x1853164379264128:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164446:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164471:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1767317541.164482:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:18379:x1853164379264128:12345-192.168.202.133@tcp:104: Request processed in 41us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164487:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9543 00000100:00100000:3.0:1767317541.164499:0:42091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9544 00000100:00100000:3.0:1767317541.164504:0:42091:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379264512:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.164511:0:42091:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.164540:0:42091:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1767317541.164546:0:42091:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c58fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:41753:x1853164379264512:12345-192.168.202.133@tcp:104: Request processed in 42us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.164551:0:42091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9544 00010000:00010000:0.0:1767317541.164654:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1767317541.164669:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164676:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1e00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.164683:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164726:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164732:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.164758:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164766:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1e00/0x73c3d5cb1442d945 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73e74 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164789:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1767317541.164792:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164800:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.164803:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164820:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164838:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.164847:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164854:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1800/0x73c3d5cb1442cfd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a718c6 expref: -99 pid: 81471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164867:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1767317541.164899:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164906:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1400 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.164911:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164931:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164937:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.164942:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164949:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1400/0x73c3d5cb1442d103 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71c85 expref: -99 pid: 82062 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164963:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1767317541.164975:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.164982:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.164986:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165008:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165014:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.165020:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165027:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1200/0x73c3d5cb1442cda6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71213 expref: -99 pid: 79381 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165041:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767317541.165044:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165050:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c629d1800 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.165053:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165070:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165086:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.165092:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165099:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c629d1800/0x73c3d5cb1442d20d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a71f72 expref: -99 pid: 82646 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165113:0:63490:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317541.165116:0:63490:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165122:0:63490:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af1200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.165126:0:63490:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165157:0:63490:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165163:0:63490:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.165168:0:63490:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165175:0:63490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c43af1200/0x73c3d5cb1442d984 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a73faf expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.165186:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.165194:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.165196:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.165203:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317541.165220:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806336:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.165280:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806592:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.165299:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806848:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.165322:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1767317541.165326:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.165339:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806720:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.165353:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806976:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767317541.165921:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.165939:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.165944:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.165950:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317541.191829:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.200855:0:56341:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767317541.200978:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379265664 00000100:00100000:3.0:1767317541.200988:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379265664 00000100:00100000:3.0:1767317541.201044:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9545 00000100:00100000:3.0:1767317541.201055:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:41361:x1853164379265664:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.201074:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201168:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317541.201175:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c42fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:41361:x1853164379265664:12345-192.168.202.133@tcp:104: Request processed in 123us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.201182:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9545 00010000:00010000:3.0:1767317541.201228:0:42098:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767317541.201235:0:42098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201264:0:42098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc000 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:3.0:1767317541.201271:0:42098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201315:0:42098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201323:0:42098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767317541.201346:0:42098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201354:0:42098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc000/0x73c3d5cb1442da17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74202 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.201376:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317541.201378:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317541.201380:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317541.201396:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291807104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317541.201859:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:0.0:1767317541.202403:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806336:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.202438:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806592:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.202448:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806848:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.202472:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806464:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317541.202478:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379266688 00000100:00100000:0.0:1767317541.202480:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806720:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317541.202483:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379266688 00000100:00100000:0.0:1767317541.202488:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291806976:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317541.202532:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9546 00000100:00100000:3.0:1767317541.202540:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c5a28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48789:x1853164379266688:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.202551:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.202605:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317541.202622:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c5a28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48789:x1853164379266688:12345-192.168.202.133@tcp:104: Request processed in 82us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.202637:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9546 00010000:00010000:0.0:1767317541.203188:0:63742:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317541.203195:0:63742:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.203215:0:63742:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccc600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.203222:0:63742:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.203254:0:63742:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.203261:0:63742:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.203280:0:63742:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.203287:0:63742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccc600/0x73c3d5cb1442d9a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a74042 expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.203305:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.203306:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.203308:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317541.203330:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317541.203342:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807232:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767317541.205829:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317541.205906:0:2511:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:2.0:1767317541.205940:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379266816 00000100:00100000:2.0:1767317541.205948:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379266816 00000100:00100000:2.0:1767317541.206002:0:42090:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379267584 00000100:00100000:2.0:1767317541.206006:0:42090:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379267584 00000100:00100000:2.0:1767317541.206023:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9547 00000100:00100000:2.0:1767317541.206033:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c5a28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:19256:x1853164379266816:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317541.206066:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317541.206150:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767317541.206157:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c5a28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:19256:x1853164379266816:12345-192.168.202.133@tcp:104: Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317541.206165:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9547 00000100:00100000:2.0:1767317541.206183:0:42090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9548 00000100:00100000:2.0:1767317541.206190:0:42090:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c5a28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18378:x1853164379267584:12345-192.168.202.133@tcp:104: 00010000:00010000:2.0:1767317541.206198:0:42090:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317541.206227:0:42090:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1767317541.206233:0:42090:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c5a28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18378:x1853164379267584:12345-192.168.202.133@tcp:104: Request processed in 44us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1767317541.206238:0:42090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9548 00010000:00010000:0.0:1767317541.206506:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767317541.206513:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206523:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccd600 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.206529:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206589:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206596:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.206615:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206622:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccd600/0x73c3d5cb1442d9bc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7408f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206654:0:63276:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317541.206658:0:63276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206664:0:63276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c58ccda00 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:0.0:1767317541.206668:0:63276:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206686:0:63276:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206692:0:63276:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767317541.206698:0:63276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206705:0:63276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c58ccda00/0x73c3d5cb1442d9d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a740dc expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317541.206724:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.206726:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317541.206727:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317541.206745:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807360:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.206809:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317541.206815:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807488:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317541.206841:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317541.213985:0:2512:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1767317541.214186:0:56341:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379267968 00000100:00100000:3.0:1767317541.214197:0:56341:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379267968 00000100:00100000:3.0:1767317541.214253:0:56341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 9549 00000100:00100000:3.0:1767317541.214262:0:56341:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3c5a288700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19290:x1853164379267968:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1767317541.214280:0:56341:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767317541.214361:0:56341:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767317541.214368:0:56341:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3c5a288700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19290:x1853164379267968:12345-192.168.202.133@tcp:104: Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1767317541.214375:0:56341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 9549 00010000:00010000:1.0:1767317541.214739:0:42099:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767317541.214748:0:42099:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.214758:0:42099:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff8c3c43af0200 already unused, calling callback (ffffffffc128f0e0) 00010000:00010000:1.0:1767317541.214764:0:42099:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.214824:0:42099:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.214833:0:42099:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767317541.214857:0:42099:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.214865:0:42099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8c3c49ba6000 lock: ffff8c3c43af0200/0x73c3d5cb1442d9f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x541306ba06a7416f expref: -99 pid: 83367 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767317541.214905:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.214907:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317541.214909:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317541.214928:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807616:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317541.217456:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291807104:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317541.217622:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807488:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317541.217643:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807360:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767317541.217669:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807232:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767317541.227151:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807616:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767317541.731498:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767317541.790610:0:83647:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-flr: finish cleanup 20:32:20 (1767317540) === 00010000:00010000:1.0:1767317542.756815:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317543.457538:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.457677:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.457715:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1767317543.457722:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291807744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.457751:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.457777:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.465483:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291807744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.465507:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.465518:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.469683:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8c3c49ba6000: committing for last_committed 4294976370 gen 1 00000100:00100000:0.0:1767317543.469813:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291808000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317543.469846:0:2517:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8c3c49ba6000: committing for last_committed 8589937481 gen 1 00000100:00100000:0.0:1767317543.470052:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291807872:192.168.202.133@tcp:400:kworker.0 00010000:00010000:1.0:1767317543.781581:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317544.801273:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767317545.825613:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317546.852341:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317547.873038:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317548.578322:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291808512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317548.578976:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291808384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317548.579124:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291808768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317548.580321:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291808640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317548.580371:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291808896:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317548.593400:0:2519:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8c3c49ba6000 of lustre-MDT0000_UUID@192.168.202.133@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1767317548.593409:0:2519:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1767317548.593530:0:2519:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8c3c49ba6000: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1767317548.602403:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291808640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317548.602441:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291808896:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317548.621420:0:2519:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317548.621437:0:2519:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 1399 00000100:00080000:2.0:1767317548.621500:0:2519:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317548.621511:0:2519:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317548.621548:0:2519:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291809024/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317548.625167:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291808512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317548.628971:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291809024:192.168.202.133@tcp:38:ptlrpcd_01_00.0 00000100:00100000:3.0:1767317548.632172:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291808768:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317548.669623:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317548.669641:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317548.669647:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291809024:192.168.202.133@tcp:38:ptlrpcd_01_00.0 00010000:00010000:0.0:1767317548.897055:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317549.921821:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317550.946624:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317551.970664:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317552.993232:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317553.697147:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317553.697157:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1767317553.697265:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291809152:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767317553.698045:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317553.698054:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2453 00000100:00080000:3.0:1767317553.698063:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1767317553.698072:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317553.698085:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317553.698110:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291809280/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317553.698189:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291809280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317553.698677:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317553.698739:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317553.698946:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317553.698955:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317553.704442:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317553.704465:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317553.705832:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291809408:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317553.706680:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317553.706690:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317553.706694:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291809280:192.168.202.133@tcp:38:kworker.0 00010000:00010000:1.0:1767317554.017571:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317555.041279:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317556.065068:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317557.088991:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317557.793450:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291809792:192.168.202.133@tcp:17:kworker.0 00000100:00100000:3.0:1767317557.801292:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291809792:192.168.202.133@tcp:17:kworker.0 00010000:00010000:0.0:1767317558.114637:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317558.817369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317558.817375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1767317558.817475:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291809920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317558.817839:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317558.817845:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2458 00000100:00080000:1.0:1767317558.817853:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1767317558.817860:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317558.817911:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317558.817935:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291810048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317558.819225:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317558.819334:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317558.820212:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317558.820270:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317558.820298:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810304:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317558.826555:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317558.826578:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317558.826585:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317558.826835:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317558.826850:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317558.826863:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810432:192.168.202.133@tcp:400:kworker.0 00010000:00010000:1.0:1767317559.138247:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317560.161062:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317561.185369:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317562.211320:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317563.234182:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317563.937610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317563.937620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317563.937626:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317563.937640:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2463 00000100:00080000:1.0:1767317563.937656:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767317563.937665:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317563.937679:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317563.937700:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291810688/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317563.937748:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c4306a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1767317563.937751:0:36:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8c3c49ba6000: disconnect after 22s idle 00000100:00080000:1.0:1767317563.937767:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c44c31000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1767317563.937770:0:36:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8c3c49ba6000: disconnect after 22s idle 00000100:00100000:2.0:1767317563.937785:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317563.937955:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810944:192.168.202.133@tcp:9:kworker.0 00000100:00100000:2.0:1767317563.937995:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811072:192.168.202.133@tcp:9:kworker.0 00000100:00100000:0.0:1767317563.938439:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810816:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317563.938487:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317563.938495:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2518:1853164291810560:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317563.943196:0:2516:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8c3c46ab3100 x1853164291811072/t0(0) o9->lustre-OST0001-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 0 dl 1767317573 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317563.943198:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291810816:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317563.943235:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c44c31000 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:2.0:1767317563.943240:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811072:192.168.202.133@tcp:9:kworker.0 00000100:00080000:2.0:1767317563.943256:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317563.943261:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317563.943265:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810688:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317563.944296:0:2516:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8c3c46ab3480 x1853164291810944/t0(0) o9->lustre-OST0000-osc-ffff8c3c49ba6000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 0 dl 1767317573 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317563.944309:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c4306a800 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:1.0:1767317563.944314:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291810944:192.168.202.133@tcp:9:kworker.0 00010000:00010000:2.0:1767317564.257155:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1767317564.897081:0:2520:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317548/real 1767317548] req@ffff8c3c58fc3b80 x1853164291808384/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 1 dl 1767317564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317564.933283:0:2520:0:(client.c:2522:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c3c58fc3b80 x1853164291808384/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 1 dl 1767317564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317564.933304:0:2520:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1767317564.933309:0:2520:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.133@tcp: Connection to MGS (at 192.168.202.133@tcp) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1767317564.950089:0:2520:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.202.133@tcp for MGC192.168.202.133@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1767317564.950097:0:2520:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1767317564.950110:0:2520:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c3c58fc3b80 x1853164291808384/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 1 dl 1767317564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317564.950129:0:2520:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c3c58fc2680 x1853164291809152/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 0 dl 1767317569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317564.950189:0:2520:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c3c46ab3800 x1853164291809920/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 0 dl 1767317574 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317564.950215:0:2520:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c3c46ab2680 x1853164291810560/t0(0) o400->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 224/224 e 0 to 0 dl 1767317579 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1767317564.950229:0:2520:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1767317564.950233:0:2520:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1767317564.950234:0:2520:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1767317564.950237:0:2520:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1767317564.950275:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2520:1853164291808384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317564.950365:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2517:1853164291809920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317564.950825:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60611719-01b9-46d2-ac0c-8576fdd7db4f:2519:1853164291809152:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767317564.953526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317564.956583:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317564.956604:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317564.956620:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 1398 00000100:00080000:3.0:1767317564.956641:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317564.956703:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291811200/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317564.956752:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317564.956757:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317564.956759:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317564.956763:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2468 00000100:00080000:3.0:1767317564.956768:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317564.956772:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317564.956783:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317564.956794:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291811328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317564.956912:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291811456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317564.957413:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60611719-01b9-46d2-ac0c-8576fdd7db4f:2518:1853164291810560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317564.957506:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291811200:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317564.957632:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811328:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317564.977826:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317564.977847:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317564.977853:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317564.991438:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291811456:192.168.202.133@tcp:400:kworker.0 00010000:00010000:0.0:1767317565.283540:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317566.305148:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317567.329132:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317568.353936:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317568.993581:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317568.993595:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317568.993597:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317568.993602:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317568.993628:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317568.993641:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2469 00000100:00080000:1.0:1767317568.993658:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317568.993666:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317568.993682:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317568.993727:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291811584/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317568.993815:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291811712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317568.994229:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811584:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317569.008791:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317569.008836:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317569.008843:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317569.009747:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291811712:192.168.202.133@tcp:400:kworker.0 00010000:00010000:0.0:1767317569.377105:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317570.017205:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317570.017215:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317570.017218:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317570.017222:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317570.017226:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317570.017237:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2473 00000100:00080000:3.0:1767317570.017248:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317570.017256:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317570.017268:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317570.017303:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291811840/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317570.017364:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811840:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317570.017568:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291811968:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317570.028639:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291811968:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317570.029584:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317570.029595:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317570.029600:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291811840:192.168.202.133@tcp:38:kworker.0 00010000:00010000:1.0:1767317570.403587:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317571.425775:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317572.449099:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317573.481129:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317574.115123:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317564/real 1767317564] req@ffff8c3c58fc3b80 x1853164291811200/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317574 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317574.115167:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3b80 x1853164291811200/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317574 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317574.115191:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317574.115221:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317574.115226:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291811200:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317574.115317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317574.115323:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317574.115327:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317574.115341:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2469 00000100:00080000:3.0:1767317574.115354:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1767317574.115362:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317574.115426:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291812096/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317574.115454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317574.115458:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317574.115459:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317574.115463:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2474 00000100:00080000:3.0:1767317574.115468:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317574.115472:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317574.115483:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317574.115495:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291812224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317574.115697:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291812096:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317574.115854:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317574.116690:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317574.116702:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291812352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317574.128330:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291812352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317574.128668:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317574.128675:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317574.128678:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812224:192.168.202.133@tcp:38:kworker.0 00010000:00010000:0.0:1767317574.497088:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317575.521073:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317576.546967:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317577.573091:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317578.593042:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317579.307390:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317579.307405:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317579.307408:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317579.307412:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317579.307427:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317579.307440:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2479 00000100:00080000:3.0:1767317579.307455:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317579.307469:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317579.307509:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317579.307553:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291812480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317579.307857:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291812608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317579.311418:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317579.326173:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291812608:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317579.342783:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317579.342809:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317579.342815:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812480:192.168.202.133@tcp:38:kworker.0 00010000:00010000:1.0:1767317579.617151:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317580.644938:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317581.667020:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767317582.090023:0:84171:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: auster : @@@@@@ FAIL: Restart of mds1 failed! 00010000:00010000:2.0:1767317582.689080:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317583.716121:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317584.418305:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317584.418317:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317584.418319:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317584.418324:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317584.418327:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317584.418338:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2484 00000100:00080000:2.0:1767317584.418349:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317584.418356:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317584.418368:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317584.418398:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291812736/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317584.418479:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291812864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317584.418901:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317584.446935:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291812864:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317584.450981:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317584.450995:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317584.451000:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291812736:192.168.202.133@tcp:38:kworker.0 00010000:00010000:0.0:1767317584.738512:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317585.761973:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767317586.785219:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1767317587.745090:0:84504:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8c3c485b63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767317587.745103:0:84504:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8c3c485b63c8),name=/ 00000002:00010000:0.0:1767317587.745128:0:84504:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767317587.745269:0:84504:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442da1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 84504 initiator: MDT0 00010000:00010000:0.0:1767317587.745279:0:84504:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442da1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84504 initiator: MDT0 00010000:00010000:0.0:1767317587.745289:0:84504:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8c3c49ba6000 lock: ffff8c3c58ccca00/0x73c3d5cb1442da1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84504 initiator: MDT0 00000100:00080000:0.0:1767317587.745316:0:84504:0:(client.c:1829:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c3c50e9d500 x1853164291812992/t0(0) o101->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 576/4336 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767317587.745327:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317587.809115:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317588.769095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317588.833133:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317589.538682:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317574/real 1767317574] req@ffff8c3c58fc0a80 x1853164291812096/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317589.538752:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0a80 x1853164291812096/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317589.538774:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317589.538783:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767317589.538788:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291812096:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767317589.540569:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317589.540577:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317589.540591:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317589.540602:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2479 00000100:00080000:1.0:1767317589.540615:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1767317589.540623:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767317589.540660:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291813120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317589.540689:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317589.540693:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317589.540696:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317589.540700:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2489 00000100:00080000:1.0:1767317589.540712:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317589.540717:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317589.540727:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317589.540740:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291813248/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317589.540789:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317589.540807:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291813376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317589.542332:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291813120:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767317589.542431:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813248:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317589.547234:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317589.547250:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317589.547256:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813248:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317589.547854:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291813376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317589.793432:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317589.857056:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317590.818085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317590.883031:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317591.841227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317591.905499:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317592.865083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317592.929173:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317593.889025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317593.953641:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317594.657604:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317594.657620:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317594.657623:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317594.657628:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317594.657633:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317594.657646:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2494 00000100:00080000:3.0:1767317594.657669:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317594.657678:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317594.657693:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317594.657741:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291813504/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317594.657832:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317594.657847:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291813632:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317594.658163:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813504:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317594.664373:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317594.664417:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317594.664423:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317594.668631:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291813632:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317594.913216:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317594.978575:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317595.937200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317596.001451:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317596.964093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317597.025035:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317597.985179:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317598.053320:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317599.009128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317599.074051:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317599.777139:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317599.777151:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317599.777154:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317599.777158:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317599.777164:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317599.777177:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2499 00000100:00080000:1.0:1767317599.777192:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317599.777200:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317599.777216:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317599.777266:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164291813760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317599.777337:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317599.777362:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291813888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317599.799216:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291813888:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317599.799325:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317599.799332:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317599.799336:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291813760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317600.033041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317600.097331:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317601.057104:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317601.121342:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317602.081190:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317602.145213:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317603.105742:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317603.169539:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317604.129045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317604.193695:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317604.898044:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317604.898053:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317604.898083:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317604.898087:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317604.898091:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317604.898101:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2504 00000100:00080000:3.0:1767317604.898112:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317604.898119:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317604.898132:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317604.898417:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291814016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317604.898988:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317604.899354:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317604.899367:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291814144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317604.911072:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317604.911086:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317604.911092:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317604.917700:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291814144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317605.153066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317605.227782:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317606.177114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317606.241015:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317607.201087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317607.265533:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317608.226764:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317608.290105:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317609.249033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317609.313308:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317610.017178:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317610.017191:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317610.017193:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317610.017197:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317610.017202:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317610.017213:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2509 00000100:00080000:3.0:1767317610.017228:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317610.017235:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317610.017248:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317610.017284:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291814272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317610.018857:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291814400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317610.020440:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317589/real 1767317589] req@ffff8c3c46ab3480 x1853164291813120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317610.020479:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3480 x1853164291813120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317610.020506:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814272:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317610.020643:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317610.020656:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317610.020663:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291813120:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767317610.020756:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317610.020790:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317610.020793:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317610.020801:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2494 00000100:00080000:0.0:1767317610.020810:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1767317610.020817:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767317610.020845:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291814528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317610.020927:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291814528:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767317610.025245:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291814400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317610.025961:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317610.025969:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317610.025973:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317610.272961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317610.337168:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317611.297018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317611.361712:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317612.321034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317612.385027:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317613.345014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317613.409125:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317614.369281:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317614.433230:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317615.137165:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317615.137176:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317615.137178:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317615.137182:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317615.137204:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317615.137227:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2514 00000100:00080000:1.0:1767317615.137238:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317615.137245:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317615.137257:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317615.137289:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291814656/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317615.137384:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317615.137397:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291814784:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317615.137808:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814656:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317615.146760:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317615.146776:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317615.146781:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814656:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317615.146939:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291814784:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317615.393069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317615.457026:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317616.417111:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317616.481825:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317617.441077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317617.508020:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317618.467896:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317618.529216:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317619.488989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317619.555760:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317620.257085:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317620.257094:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317620.257098:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317620.257103:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317620.257108:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317620.257118:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2520 00000100:00080000:2.0:1767317620.257129:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317620.257136:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317620.257232:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317620.257273:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291814912/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317620.257339:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317620.257353:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291815040:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317620.257611:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317620.270163:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291815040:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317620.275539:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317620.275556:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317620.275561:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291814912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317620.514402:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317620.577202:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317621.537031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317621.609736:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317622.561021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317622.625295:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317623.586020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317623.650238:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317624.608994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317624.673040:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317625.377092:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317625.377102:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317625.377124:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317625.377129:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317625.377143:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317625.377156:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2525 00000100:00080000:3.0:1767317625.377170:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317625.377178:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317625.377192:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317625.377226:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291815168/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317625.377505:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291815296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317625.377646:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317625.385015:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291815296:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317625.399729:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317625.399746:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317625.399751:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317625.633058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317625.699804:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317626.657003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317626.721093:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317627.681697:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317627.745948:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317628.705088:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317628.771492:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317629.732904:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317629.793105:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317630.497131:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317630.497145:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317630.497148:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317630.497153:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317630.497156:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317630.497168:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2530 00000100:00080000:0.0:1767317630.497181:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317630.497188:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317630.497201:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317630.497249:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291815424/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317630.497366:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291815552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317630.497530:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317630.500501:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291815552:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317630.508648:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317630.508665:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317630.508671:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317630.753777:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317630.818629:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317631.777175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317631.841638:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317632.801020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317632.865111:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317633.824961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317633.889085:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317634.849011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317634.913264:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317635.617045:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317610/real 1767317610] req@ffff8c3c50e9ce00 x1853164291814528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317635.617081:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ce00 x1853164291814528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317635.617136:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317635.617146:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317635.617150:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291814528:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317635.619309:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317635.619319:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317635.619324:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317635.619333:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2514 00000100:00080000:3.0:1767317635.619343:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317635.619350:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317635.619386:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291815680/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317635.619425:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317635.619428:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317635.619430:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317635.619435:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2535 00000100:00080000:3.0:1767317635.619438:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317635.619442:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317635.619467:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317635.619481:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291815808/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317635.619556:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291815936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317635.621054:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291815680:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317635.621129:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815808:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317635.627150:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317635.627166:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317635.627172:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291815808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317635.627546:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291815936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317635.876015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317635.937051:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317636.897015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317636.962019:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317637.921398:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317637.988247:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317638.945032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317639.009485:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317639.969863:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317640.033029:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317640.737151:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317640.737162:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317640.737165:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317640.737169:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317640.737174:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317640.737185:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2540 00000100:00080000:3.0:1767317640.737196:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317640.737202:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317640.737215:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317640.737282:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291816064/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317640.737460:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291816192:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317640.739299:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317640.740298:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291816192:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317640.746071:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317640.746087:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317640.746093:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317640.995008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317641.058727:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317642.020382:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317642.081384:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317643.041375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317643.108552:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317644.065073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317644.129131:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317645.089116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317645.154595:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317645.865408:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317645.865431:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317645.865435:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317645.865440:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317645.865444:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317645.865455:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2545 00000100:00080000:2.0:1767317645.865468:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317645.865476:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317645.865489:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317645.865773:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291816320/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317645.866002:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317645.866022:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291816448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317645.866970:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317645.881867:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291816448:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317645.888298:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317645.888314:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317645.888320:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317646.114724:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317646.177035:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317647.137170:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317647.201196:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317648.161098:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317648.226515:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317649.185051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317649.249269:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317650.209023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317650.273357:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317650.977432:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317650.977444:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317650.977448:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317650.977451:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317650.977456:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317650.977466:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2550 00000100:00080000:3.0:1767317650.977478:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317650.977486:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317650.977528:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317650.977560:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291816576/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317650.977630:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317650.977650:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291816704:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317650.978119:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317650.992769:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291816704:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317650.994069:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317650.994080:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317650.994085:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317651.233363:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317651.297178:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317652.257036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317652.321033:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317653.281275:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317653.345952:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317654.305013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317654.369530:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317655.328999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317655.393199:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317656.096985:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317656.096996:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317656.097000:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317656.097004:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317656.097088:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317656.097100:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2555 00000100:00080000:3.0:1767317656.097118:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317656.097126:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317656.097139:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317656.097170:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291816832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317656.097263:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291816960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317656.098692:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317656.100724:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291816960:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317656.102142:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317656.102160:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317656.102167:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291816832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317656.353052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317656.420829:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317657.377022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317657.442562:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317658.401160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317658.465063:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317659.426222:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317659.491770:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317660.200578:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317635/real 1767317635] req@ffff8c3c58fc0000 x1853164291815680/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317660.200674:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0000 x1853164291815680/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317660 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317660.200704:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317660.200748:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317660.200753:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291815680:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767317660.201565:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317660.201575:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317660.201580:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317660.201589:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2540 00000100:00080000:2.0:1767317660.201604:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317660.201613:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767317660.201659:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291817088/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317660.201694:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317660.201698:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317660.201700:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317660.201704:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2560 00000100:00080000:2.0:1767317660.201707:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317660.201711:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317660.201724:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317660.201737:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291817216/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317660.201800:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317660.201818:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291817344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317660.202081:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291817088:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767317660.202123:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817216:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317660.210930:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317660.210956:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317660.210963:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317660.214697:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291817344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317660.449164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317660.513145:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317661.473097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317661.537257:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317662.502242:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317662.561311:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317663.521105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317663.586074:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317664.550253:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317664.611175:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317665.313265:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317665.313279:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317665.313283:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317665.313287:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317665.313293:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317665.313307:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2565 00000100:00080000:3.0:1767317665.313321:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317665.313354:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317665.313369:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317665.313414:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291817472/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317665.313506:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291817600:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317665.314001:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817472:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317665.328360:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317665.328381:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317665.328387:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817472:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317665.328991:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291817600:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317665.569836:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317665.633278:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317666.593041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317666.657899:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317667.617079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317667.682438:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317668.644350:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317668.706385:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317669.665518:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317669.729318:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317670.433845:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317670.433861:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317670.433893:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317670.433899:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317670.433905:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317670.433919:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2570 00000100:00080000:3.0:1767317670.433933:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317670.433941:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317670.433958:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317670.434015:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291817728/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317670.434107:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291817856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317670.434439:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317670.449371:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291817856:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317670.449621:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317670.449631:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317670.449645:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317670.691187:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317670.753108:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317671.713054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317671.779955:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317672.737017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317672.801123:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317673.762145:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317673.825234:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317674.785081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317674.849656:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317675.553055:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317675.553066:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317675.553069:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317675.553072:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317675.553077:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317675.553088:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2575 00000100:00080000:3.0:1767317675.553121:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317675.553131:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317675.553144:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317675.553178:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291817984/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317675.553343:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291818112:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317675.555159:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317675.556421:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291818112:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317675.558160:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317675.558175:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317675.558181:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291817984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317675.809036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317675.875337:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317676.833117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317676.898330:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317677.857008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317677.921761:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317678.881076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317678.945333:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317679.905562:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317679.970416:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317680.674172:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317680.674189:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317680.674192:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317680.674197:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317680.674203:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317680.674217:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2580 00000100:00080000:0.0:1767317680.674233:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317680.674242:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317680.674258:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317680.674309:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291818240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317680.674424:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291818368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317680.677985:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317680.681365:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291818368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317680.681437:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317680.681453:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317680.681458:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317680.930015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317680.993776:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317681.953025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317682.023860:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317682.977047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317683.041417:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317684.000972:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317684.066950:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317685.025021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317685.089175:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317685.793074:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317660/real 1767317660] req@ffff8c3c5a289f80 x1853164291817088/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317685.793119:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289f80 x1853164291817088/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317685.793144:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317685.793155:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317685.793160:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291817088:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767317685.793553:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317685.793561:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317685.793564:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317685.793570:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2565 00000100:00080000:1.0:1767317685.793607:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317685.793626:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767317685.793664:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291818496/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317685.793692:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317685.793696:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317685.793698:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317685.793702:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2585 00000100:00080000:1.0:1767317685.793705:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317685.793708:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317685.793719:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317685.793729:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291818624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317685.793789:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291818752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317685.794299:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291818496:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317685.794339:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818624:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317685.797122:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317685.797137:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317685.797143:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317685.805271:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291818752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317686.049055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317686.113349:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317687.074345:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317687.138586:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317688.097027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317688.162069:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317689.123107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317689.185314:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317690.145664:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317690.209327:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317690.913132:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317690.913156:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317690.913160:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317690.913167:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317690.913178:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317690.913193:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2590 00000100:00080000:3.0:1767317690.913210:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317690.913220:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317690.913236:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317690.913310:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291818880/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317690.913564:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291819008:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317690.913822:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317690.920470:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291819008:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317690.924654:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317690.924676:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317690.924706:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291818880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317691.169031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317691.233121:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317692.193018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317692.257172:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317693.217010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317693.281373:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317694.241843:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317694.305149:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317695.267736:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317695.329161:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317696.033559:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317696.033574:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317696.033578:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317696.033583:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317696.033590:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317696.033629:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2595 00000100:00080000:3.0:1767317696.033645:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317696.033653:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317696.033670:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317696.033714:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291819136/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317696.033826:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317696.033849:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291819264:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317696.034352:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317696.038269:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291819264:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317696.040529:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317696.040550:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317696.040557:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317696.290149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317696.354067:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317697.313030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317697.379583:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317698.337688:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317698.403007:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317699.361090:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317699.426919:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317700.385048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317700.449088:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317701.153944:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317701.153959:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317701.153962:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317701.153966:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317701.153971:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317701.153984:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2600 00000100:00080000:0.0:1767317701.153999:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317701.154009:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317701.154023:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317701.154075:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291819392/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317701.154158:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291819520:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317701.154923:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317701.162529:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291819520:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317701.163348:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317701.163361:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317701.163367:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317701.412217:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317701.473377:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317702.433112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317702.497615:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317703.457011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317703.521229:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317704.481046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317704.545222:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317705.505019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317705.574063:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317706.273481:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317706.273496:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317706.273500:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317706.273504:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317706.273509:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317706.273522:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2606 00000100:00080000:2.0:1767317706.273537:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317706.273548:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317706.273563:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317706.273629:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291819648/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317706.275460:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317706.276534:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317706.276559:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291819776:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317706.281912:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317706.281929:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317706.281935:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291819648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317706.283720:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291819776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317706.529012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317706.593118:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317707.553017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317707.617021:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317708.577084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317708.641480:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317709.601205:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317709.665101:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317710.369168:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317685/real 1767317685] req@ffff8c3c46ab3800 x1853164291818496/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317710.369215:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3800 x1853164291818496/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317710.369236:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317710.369259:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317710.369263:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291818496:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317710.370395:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317710.370407:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317710.370413:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317710.370425:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2590 00000100:00080000:3.0:1767317710.370438:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317710.370447:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317710.370540:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291819904/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317710.370572:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317710.370577:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317710.370580:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317710.370584:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2611 00000100:00080000:3.0:1767317710.370589:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317710.370593:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317710.370637:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317710.370653:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291820032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317710.370721:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291819904:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767317710.370733:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317710.370752:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291820160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317710.373098:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820032:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317710.380918:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317710.380932:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317710.380938:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317710.381325:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291820160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317710.625585:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317710.689467:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317711.648997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317711.713443:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317712.673013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317712.743209:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317713.697059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317713.761469:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317714.720960:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317714.785108:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317715.489085:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317715.489096:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317715.489099:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317715.489103:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317715.489107:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317715.489117:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2615 00000100:00080000:2.0:1767317715.489128:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317715.489136:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317715.489151:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317715.489189:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291820288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317715.489272:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317715.489297:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291820416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317715.489476:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317715.492560:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291820416:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317715.497666:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317715.497687:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317715.497694:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317715.745903:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317715.815760:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317716.769097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317716.833106:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317717.793031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317717.859011:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317718.817063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317718.881104:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317719.844478:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317719.907461:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317720.609515:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317720.609538:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317720.609542:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317720.609565:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317720.609570:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317720.609582:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2620 00000100:00080000:2.0:1767317720.609597:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317720.609605:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317720.609619:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317720.609658:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291820544/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317720.609969:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317720.609992:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291820672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317720.610726:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317720.620104:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291820672:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317720.621160:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317720.621173:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317720.621178:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317720.865157:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317720.929338:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317721.889087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317721.953655:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317722.913124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317722.979944:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317723.938944:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767317724.001234:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317724.962092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317725.025231:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317725.729185:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317725.729201:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317725.729212:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317725.729217:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317725.729222:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317725.729237:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2625 00000100:00080000:2.0:1767317725.729251:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317725.729260:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317725.729276:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317725.729343:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291820800/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317725.729445:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317725.729468:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291820928:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317725.730771:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820800:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317725.738931:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291820928:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317725.741405:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317725.741423:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317725.741429:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291820800:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317725.985031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317726.049268:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317727.009081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317727.073857:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317728.033807:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317728.097106:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317729.057062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317729.125110:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317730.080981:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317730.145143:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317730.849039:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317730.849055:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317730.849059:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317730.849063:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317730.849068:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317730.849083:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2630 00000100:00080000:2.0:1767317730.849098:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317730.849107:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317730.849133:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317730.849186:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291821056/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317730.849363:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291821184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317730.850151:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821056:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317730.856390:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317730.856412:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317730.856419:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317730.856544:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291821184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317731.105180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317731.170787:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317732.129762:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317732.193144:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317733.153181:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767317733.218551:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317734.177092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317734.243008:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317735.201125:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317735.267372:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317735.969189:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317710/real 1767317710] req@ffff8c3c58fc1880 x1853164291819904/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317735 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317735.969231:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1880 x1853164291819904/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317735 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317735.969252:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317735.969263:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317735.969267:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291819904:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317735.969354:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317735.969367:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317735.969371:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317735.969382:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2615 00000100:00080000:3.0:1767317735.969425:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317735.969433:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317735.969475:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291821312/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317735.969505:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317735.969508:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317735.969510:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317735.969513:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2635 00000100:00080000:3.0:1767317735.969518:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317735.969537:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767317735.969541:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291821312:192.168.202.133@tcp:250:kworker.0 00000008:00100000:3.0:1767317735.969556:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317735.969579:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291821440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317735.969637:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291821568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317735.969679:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317735.986442:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291821568:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317735.987059:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317735.987069:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317735.987093:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317736.226183:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317736.289161:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317737.249146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317737.313084:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317738.273071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317738.340709:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317739.296961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317739.367990:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317740.322580:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317740.385434:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317741.091483:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317741.091494:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317741.091497:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317741.091501:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317741.091505:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317741.091517:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2640 00000100:00080000:2.0:1767317741.091530:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317741.091537:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317741.091550:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317741.091596:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291821696/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317741.091668:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317741.091910:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317741.091929:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291821824:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317741.113172:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317741.113196:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317741.113202:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317741.115467:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291821824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317741.345058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317741.409014:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317742.373043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767317742.433425:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317743.394618:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317743.457828:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317744.420025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317744.481222:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317745.441965:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317745.506088:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317746.209154:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317746.209168:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317746.209171:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317746.209176:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317746.209183:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317746.209207:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2645 00000100:00080000:0.0:1767317746.209222:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317746.209231:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317746.209245:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317746.209303:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291821952/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317746.209385:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317746.209405:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291822080:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317746.211243:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317746.217941:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291822080:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317746.219061:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317746.219073:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317746.219079:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291821952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317746.465101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317746.529114:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317747.490808:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317747.554270:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317748.513817:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317748.577193:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317749.537022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317749.601476:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317750.561741:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317750.625449:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317751.329100:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317751.329118:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317751.329122:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317751.329128:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317751.329135:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317751.329150:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2651 00000100:00080000:2.0:1767317751.329167:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317751.329177:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317751.329196:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317751.329259:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291822208/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317751.329376:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291822336:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317751.329669:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822208:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317751.342392:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291822336:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317751.342585:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317751.342593:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317751.342597:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822208:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317751.585401:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767317751.649288:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317752.609099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317752.673631:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317753.633109:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317753.698494:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317754.658076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317754.721345:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317755.681023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317755.745064:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317756.449059:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317756.449074:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317756.449078:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317756.449082:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317756.449088:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317756.449101:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2656 00000100:00080000:2.0:1767317756.449115:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317756.449125:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317756.449141:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317756.449232:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291822464/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317756.449335:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317756.449360:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291822592:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317756.449991:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822464:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317756.477629:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317756.477652:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317756.477658:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822464:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317756.477932:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291822592:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317756.709162:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317756.769406:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317757.729009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317757.793106:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317758.754470:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317758.817727:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317759.776989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317759.841109:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317760.545013:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317735/real 1767317735] req@ffff8c3c58fc3b80 x1853164291821312/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317760 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317760.545048:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3b80 x1853164291821312/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317760 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317760.545068:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317760.545099:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317760.545103:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291821312:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317760.545261:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317760.545267:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317760.545270:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317760.545275:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2640 00000100:00080000:3.0:1767317760.545284:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317760.545290:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317760.545322:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291822720/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317760.545346:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317760.545363:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317760.545365:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317760.545369:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2661 00000100:00080000:3.0:1767317760.545373:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317760.545377:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317760.545388:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317760.545401:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291822848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317760.545470:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317760.545486:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291822976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317760.546009:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291822720:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317760.546061:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317760.548941:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291822976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317760.551318:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317760.551333:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317760.551338:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291822848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317760.803825:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767317760.865469:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317761.826857:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317761.889125:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317762.849298:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317762.913085:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317763.873044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317763.939525:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317764.897041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317764.961075:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317765.664988:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317765.664998:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317765.665002:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317765.665006:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317765.665011:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317765.665020:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2665 00000100:00080000:3.0:1767317765.665030:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317765.665037:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317765.665048:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317765.665080:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291823104/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317765.665238:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291823232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317765.669362:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317765.670548:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291823232:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317765.682333:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317765.682349:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317765.682354:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317765.921564:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317765.988789:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317766.945087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317767.009360:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317767.969056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317768.033460:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317768.993012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317769.057107:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317770.017028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317770.081157:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317770.785109:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317770.785125:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317770.785129:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317770.785133:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317770.785139:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317770.785153:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2670 00000100:00080000:2.0:1767317770.785167:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317770.785175:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317770.785190:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317770.785238:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291823360/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317770.785313:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317770.785329:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291823488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317770.785441:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823360:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317770.790098:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767317770.790100:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291823488:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317770.790112:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317770.790130:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823360:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317771.045248:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317771.105154:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317772.066378:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317772.129611:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317773.089040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317773.154925:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317774.113957:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317774.177179:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317775.137046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317775.201127:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317775.905037:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317775.905048:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317775.905052:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317775.905055:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317775.905063:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317775.905073:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2675 00000100:00080000:3.0:1767317775.905084:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317775.905100:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317775.905112:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317775.905149:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291823616/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317775.905221:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823616:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317775.905684:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317775.905695:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291823744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317775.910139:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291823744:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317775.910260:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317775.910267:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317775.910271:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823616:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317776.161160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317776.225275:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317777.185006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317777.249123:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317778.209345:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317778.273471:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317779.233481:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317779.297462:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317780.257128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317780.321294:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317781.032701:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317781.032716:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317781.032719:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317781.032723:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317781.032729:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317781.032742:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2680 00000100:00080000:2.0:1767317781.032756:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317781.032766:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317781.032793:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317781.032842:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291823872/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317781.032954:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317781.033261:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317781.046327:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824000:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317781.048042:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317781.048059:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317781.048065:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291823872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317781.281052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317781.345130:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317782.305548:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317782.369296:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317783.330262:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317783.393136:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317784.366454:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317784.417315:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317785.122017:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317760/real 1767317760] req@ffff8c3c58fc0700 x1853164291822720/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317785.122057:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0700 x1853164291822720/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317785.122082:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317785.122108:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317785.122114:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291822720:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767317785.122408:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317785.122415:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317785.122418:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317785.122425:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2665 00000100:00080000:2.0:1767317785.122437:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317785.122446:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767317785.122483:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291824128/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317785.122544:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317785.122548:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317785.122551:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317785.122555:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2685 00000100:00080000:2.0:1767317785.122559:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317785.122564:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317785.122575:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317785.122589:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291824256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317785.122643:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291824384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317785.123185:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291824128:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767317785.123240:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317785.135391:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291824384:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317785.143565:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317785.143585:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317785.143592:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317785.377863:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317785.441107:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317786.408244:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317786.465135:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317787.425169:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317787.489247:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317788.455065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317788.513097:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317789.473041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317789.537316:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317790.241250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317790.241267:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317790.241271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317790.241275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317790.241281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317790.241294:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2690 00000100:00080000:3.0:1767317790.241561:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317790.241574:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317790.241591:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317790.241640:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291824512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317790.241744:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317790.245155:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317790.252955:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824640:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317790.252974:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317790.252982:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317790.253005:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317790.497040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317790.561111:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317791.521077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317791.585315:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317792.545320:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317792.609111:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317793.569040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317793.633228:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317794.593334:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317794.658151:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317795.364489:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317795.364501:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317795.364505:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317795.364520:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317795.364525:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317795.364535:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2695 00000100:00080000:2.0:1767317795.364566:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317795.364573:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317795.364586:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317795.364622:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291824768/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317795.364705:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317795.364725:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824896:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317795.364954:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317795.374080:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291824896:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317795.379973:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317795.379989:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317795.380007:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291824768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317795.617103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317795.681178:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317796.641161:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317796.705053:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317797.665008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317797.729029:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317798.689011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317798.757342:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317799.713023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317799.777099:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317800.481116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317800.481130:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317800.481134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317800.481138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317800.481144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317800.481157:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2700 00000100:00080000:0.0:1767317800.481171:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317800.481180:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317800.481195:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317800.481241:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291825024/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317800.481349:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825024:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317800.481548:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291825152:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317800.490368:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317800.490385:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317800.490391:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825024:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317800.490572:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291825152:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317800.737918:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317800.803736:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317801.760986:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317801.825985:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317802.785012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317802.849225:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317803.809007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317803.873288:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317804.833423:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317804.897274:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317805.601080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317805.601094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317805.601349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317805.601354:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317805.601359:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317805.601371:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2705 00000100:00080000:3.0:1767317805.601381:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317805.601388:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317805.601401:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317805.601447:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291825280/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317805.601527:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317805.601548:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291825408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317805.602569:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825280:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767317805.608485:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317805.608503:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317805.608509:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317805.611830:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291825408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317805.857839:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317805.921069:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317806.881910:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317806.945263:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317807.905168:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317807.969575:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317808.929054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317808.993017:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317809.953972:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317810.017146:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317810.721053:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317785/real 1767317785] req@ffff8c3c5a288a80 x1853164291824128/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317810 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317810.721053:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317810.721061:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317810.721064:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317810.721068:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317810.721072:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317810.721078:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2710 00000100:00100000:1.0:1767317810.721085:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288a80 x1853164291824128/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317810 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317810.721087:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317810.721093:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00080000:1.0:1767317810.721104:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1767317810.721125:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:1.0:1767317810.721129:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317810.721133:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291824128:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767317810.721153:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291825536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317810.721190:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825536:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317810.721207:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317810.721210:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317810.721212:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317810.721215:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2690 00000100:00080000:2.0:1767317810.721219:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317810.721222:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767317810.721244:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291825792/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317810.721283:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291825664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317810.721305:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291825792:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767317810.731325:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317810.731341:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317810.731359:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317810.737454:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291825664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317810.978082:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317811.041097:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317812.001374:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317812.065806:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317813.025679:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317813.089503:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317814.049149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317814.113428:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317815.073070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317815.140104:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317815.845217:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317815.845233:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317815.845262:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317815.845266:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317815.845272:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317815.845284:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2715 00000100:00080000:0.0:1767317815.845298:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317815.845308:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317815.845323:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317815.845367:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291825920/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317815.845534:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291826048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317815.845729:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825920:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317815.848917:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317815.848939:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317815.848946:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291825920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317815.849073:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291826048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317816.097101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317816.161384:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317817.121187:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317817.185404:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317818.145057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317818.211225:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317819.169179:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317819.233290:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317820.193038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317820.256981:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317820.961537:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317820.961550:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317820.961553:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317820.961557:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317820.961563:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317820.961576:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2720 00000100:00080000:1.0:1767317820.961590:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317820.961653:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317820.961670:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317820.961715:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291826176/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317820.961863:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291826304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317820.962269:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826176:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317820.982536:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291826304:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767317820.982660:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317820.982668:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767317820.982673:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826176:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317821.217043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317821.281228:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317822.240987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317822.305249:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317823.265925:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317823.333159:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317824.289019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317824.353044:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317825.313018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317825.380883:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317826.081044:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317826.081058:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317826.081061:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317826.081066:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317826.081071:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317826.081084:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2725 00000100:00080000:1.0:1767317826.081096:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317826.081104:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317826.081117:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317826.081154:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291826432/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317826.081269:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317826.081289:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291826560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317826.081742:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826432:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767317826.098314:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317826.098331:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767317826.098337:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826432:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317826.103263:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291826560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317826.337144:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317826.401135:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317827.361069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317827.425028:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317828.385053:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317828.450288:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317829.409075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317829.474921:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317830.435033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317830.498386:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317831.206041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317831.206053:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317831.206056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317831.206059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317831.206063:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317831.206074:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2730 00000100:00080000:3.0:1767317831.206084:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317831.206092:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317831.206105:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317831.206160:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291826688/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317831.206258:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291826816:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317831.206382:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826688:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317831.224100:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317831.224115:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317831.224121:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291826688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317831.224596:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291826816:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317831.458008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317831.521061:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317832.481250:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317832.545126:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317833.504987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317833.569027:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317834.529037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317834.593215:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317835.297309:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317810/real 1767317810] req@ffff8c3c5a288380 x1853164291825792/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317835.297345:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288380 x1853164291825792/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317835.297381:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317835.297394:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767317835.297399:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291825792:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767317835.298335:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317835.298342:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317835.298345:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317835.298353:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2715 00000100:00080000:0.0:1767317835.298363:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317835.298370:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767317835.298409:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291826944/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767317835.298439:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317835.298443:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317835.298444:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317835.298448:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2736 00000100:00080000:0.0:1767317835.298452:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317835.298456:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317835.298465:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317835.298475:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291827072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317835.298547:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317835.298562:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291827200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317835.298779:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291826944:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767317835.298834:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827072:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317835.317760:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317835.317778:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317835.317784:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317835.319752:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291827200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317835.553096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317835.619851:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317836.577960:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317836.641171:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317837.601089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317837.665128:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317838.625164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317838.689673:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317839.649074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317839.713729:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317840.417903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317840.417914:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317840.417918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317840.417937:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317840.417941:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317840.417952:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2740 00000100:00080000:3.0:1767317840.417963:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317840.417971:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317840.417983:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317840.418016:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291827328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317840.418144:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317840.418158:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291827456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317840.418401:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827328:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317840.422898:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317840.422913:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317840.422919:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317840.423466:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291827456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317840.672993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317840.737102:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317841.697093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317841.761096:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317842.720995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317842.785142:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317843.745004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317843.809693:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317844.769022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317844.837460:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317845.540372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317845.540387:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317845.540391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317845.540444:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317845.540450:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317845.540464:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2745 00000100:00080000:0.0:1767317845.540480:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317845.540489:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317845.540505:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317845.540562:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291827584/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317845.540678:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317845.540703:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291827712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317845.546509:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317845.549196:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291827712:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317845.557381:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317845.557413:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317845.557421:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317845.794299:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317845.857381:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317846.817212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317846.881835:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317847.841960:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317847.906047:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317848.867800:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317848.929220:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317849.890444:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317849.955546:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317850.657588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317850.657603:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317850.657607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317850.657616:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317850.657623:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317850.657636:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2750 00000100:00080000:3.0:1767317850.657650:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317850.657660:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317850.657676:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317850.657724:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291827840/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317850.657851:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291827968:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317850.658057:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827840:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317850.677972:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291827968:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317850.694219:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317850.694240:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317850.694245:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291827840:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317850.913151:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317850.979433:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317851.941228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317852.001485:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317852.960997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317853.025187:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317853.985087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317854.049646:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317855.010200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317855.073122:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317855.777062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317855.777073:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317855.777076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317855.777080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317855.777085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317855.777095:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2755 00000100:00080000:3.0:1767317855.777107:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317855.777115:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317855.777128:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317855.777163:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291828096/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317855.777252:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317855.777271:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291828224:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317855.777310:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828096:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317855.790338:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317855.790368:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317855.790374:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317855.790473:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291828224:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317856.033015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317856.097118:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317857.058655:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317857.121252:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317858.082601:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317858.145597:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317859.105395:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317859.173112:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317860.129080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317860.198495:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317860.897034:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317835/real 1767317835] req@ffff8c3c50e9c700 x1853164291826944/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317860.897074:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c700 x1853164291826944/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317860.897097:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317860.897120:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317860.897125:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291826944:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317860.897913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317860.897920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317860.897924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317860.897930:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2740 00000100:00080000:3.0:1767317860.897940:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317860.897962:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317860.897998:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291828352/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317860.898059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317860.898063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317860.898065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317860.898069:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2760 00000100:00080000:3.0:1767317860.898073:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317860.898077:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317860.898087:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317860.898101:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291828480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317860.898316:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317860.898336:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291828608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317860.900313:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291828352:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317860.900419:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317860.901376:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291828608:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317860.903282:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317860.903301:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317860.903307:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317861.153152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317861.217143:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317862.178322:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317862.241426:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317863.214043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317863.265808:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317864.225140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317864.294619:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317865.252460:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317865.315606:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317866.017235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317866.017251:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317866.017254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317866.017259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317866.017264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317866.017278:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2765 00000100:00080000:3.0:1767317866.017294:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317866.017303:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317866.017319:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317866.017366:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291828736/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317866.017486:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291828864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317866.019347:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317866.028750:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291828864:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317866.028971:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317866.028988:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317866.028994:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317866.275479:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317866.337073:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317867.297099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317867.361129:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317868.327475:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317868.385245:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317869.345117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317869.409419:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317870.369072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317870.433181:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317871.137589:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317871.137596:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317871.137599:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317871.137601:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317871.137605:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317871.137615:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2770 00000100:00080000:2.0:1767317871.137625:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317871.137631:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317871.137640:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317871.137667:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291828992/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317871.137729:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828992:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317871.137953:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317871.137963:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291829120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767317871.144725:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291829120:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317871.144815:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317871.144822:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317871.144825:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291828992:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317871.393273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317871.457340:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317872.417058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317872.486250:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317873.441029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317873.505113:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317874.465210:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317874.530276:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317875.489271:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317875.554656:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317876.258420:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317876.258431:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317876.258434:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317876.258437:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317876.258442:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317876.258453:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2776 00000100:00080000:0.0:1767317876.258463:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317876.258470:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317876.258482:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317876.258516:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291829248/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317876.258596:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317876.258613:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291829376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317876.259015:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829248:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317876.261756:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317876.261769:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317876.261785:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829248:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317876.262031:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291829376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317876.517756:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317876.577224:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317877.537040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317877.603794:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317878.562026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317878.629017:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317879.584982:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317879.649079:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317880.609365:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317880.675966:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317881.377199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317881.377210:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317881.377230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317881.377233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317881.377238:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317881.377248:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2781 00000100:00080000:0.0:1767317881.377258:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317881.377266:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317881.377278:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317881.377307:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291829504/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317881.377360:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317881.377702:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317881.377710:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291829632:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317881.386233:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317881.386250:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317881.386255:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317881.386596:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291829632:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317881.633803:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317881.698265:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317882.657052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317882.723096:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317883.680939:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317883.745148:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317884.705124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317884.770302:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317885.475042:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317860/real 1767317860] req@ffff8c3c58fc2300 x1853164291828352/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317885.475079:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2300 x1853164291828352/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317885 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317885.475101:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317885.475268:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317885.475274:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291828352:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767317885.475429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317885.475434:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317885.475438:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317885.475443:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2765 00000100:00080000:2.0:1767317885.475451:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317885.475458:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767317885.475491:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291829760/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317885.475532:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317885.475535:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317885.475537:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317885.475542:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2786 00000100:00080000:2.0:1767317885.475546:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317885.475550:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317885.475559:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317885.475571:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291829888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317885.475619:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317885.475632:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291830016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317885.477301:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291829760:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317885.477410:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829888:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317885.482424:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317885.482440:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317885.482445:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291829888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317885.483320:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291830016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317885.728959:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317885.793935:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317886.753133:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317886.817627:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317887.777023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317887.841384:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317888.801515:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317888.865379:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317889.825003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317889.889158:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317890.594061:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317890.594071:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317890.594074:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317890.594077:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317890.594082:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317890.594094:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2790 00000100:00080000:0.0:1767317890.594105:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317890.594113:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317890.594128:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317890.594178:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291830144/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317890.594285:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317890.594325:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291830272:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317890.599773:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291830272:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317890.604934:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317890.604952:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317890.604957:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317890.852421:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317890.913090:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317891.873302:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317891.937095:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317892.897110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317892.968458:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317893.923974:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317893.985066:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317894.945057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317895.009314:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317895.713046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317895.713057:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317895.713061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317895.713064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317895.713087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317895.713109:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2795 00000100:00080000:2.0:1767317895.713119:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317895.713127:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317895.713139:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317895.713169:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291830400/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317895.713522:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830400:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317895.718355:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291830528:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317895.719148:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317895.719156:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317895.719161:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830400:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317895.721597:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291830528:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317895.969502:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317896.033372:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317896.993751:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317897.057282:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317898.017121:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317898.081056:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317899.041029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317899.105697:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317900.066229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317900.129189:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317900.834582:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317900.834597:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317900.834600:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317900.834604:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317900.834609:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317900.834622:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2800 00000100:00080000:1.0:1767317900.834636:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317900.834645:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317900.834660:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317900.834704:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291830656/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317900.834781:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830656:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317900.834789:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291830784:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317900.838868:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291830784:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317900.850002:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317900.850024:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317900.850030:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830656:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317901.089054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317901.153099:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317902.117541:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317902.177343:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317903.137064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317903.201216:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317904.161216:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317904.225214:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317905.185057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317905.250099:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317905.953022:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317905.953037:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317905.953040:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317905.953044:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317905.953050:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317905.953064:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2805 00000100:00080000:1.0:1767317905.953078:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317905.953086:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317905.953101:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317905.953163:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291830912/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317905.953247:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291831040:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317905.954788:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317905.957790:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291831040:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317905.958150:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317905.958158:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317905.958163:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291830912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317906.209026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317906.279764:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317907.234375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317907.297412:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317908.257256:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317908.321196:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317909.281045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317909.346222:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317910.050220:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317885/real 1767317885] req@ffff8c3c5a288000 x1853164291829760/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317910 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317910.050253:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288000 x1853164291829760/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317910 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317910.050273:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317910.050300:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317910.050305:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291829760:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767317910.050710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317910.050716:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317910.050719:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317910.050724:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2790 00000100:00080000:1.0:1767317910.050733:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317910.050740:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767317910.050774:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291831168/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317910.050802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317910.050816:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317910.050817:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317910.050821:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2810 00000100:00080000:1.0:1767317910.050826:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317910.050830:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317910.050839:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317910.050850:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291831296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317910.050933:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291831424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317910.052912:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291831168:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317910.053001:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317910.057181:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291831424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317910.064287:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317910.064304:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317910.064310:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317910.306064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317910.369045:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317911.330065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317911.393494:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317912.352990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317912.419491:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317913.376994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317913.441517:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317914.401124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317914.465593:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317915.169223:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317915.169235:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317915.169238:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317915.169242:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317915.169246:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317915.169256:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2814 00000100:00080000:3.0:1767317915.169268:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317915.169275:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317915.169287:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317915.169324:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291831552/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317915.169413:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317915.169426:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291831680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317915.169728:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831552:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317915.175963:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317915.175980:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317915.175985:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317915.177029:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291831680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317915.427315:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317915.489124:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317916.449089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317916.513149:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317917.473213:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317917.539162:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317918.497705:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317918.561203:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317919.521228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317919.585032:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317920.289485:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317920.289497:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317920.289500:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317920.289503:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317920.289508:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317920.289518:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2820 00000100:00080000:1.0:1767317920.289529:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317920.289536:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317920.289549:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317920.289582:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291831808/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317920.289655:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291831936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317920.291592:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317920.305596:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291831936:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317920.315499:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317920.315514:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317920.315520:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291831808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317920.548210:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317920.612758:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317921.571824:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317921.635858:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317922.593065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317922.657841:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317923.617701:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317923.684158:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317924.641078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317924.707930:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317925.409030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317925.409041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317925.409044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317925.409048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317925.409073:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317925.409084:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2825 00000100:00080000:1.0:1767317925.409096:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317925.409104:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317925.409117:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317925.409154:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291832064/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317925.409218:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317925.409219:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291832192:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317925.428376:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317925.428404:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317925.428411:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317925.429191:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291832192:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317925.665084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317925.729038:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317926.689180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317926.753192:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317927.713030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317927.777736:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317928.737026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317928.801043:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317929.760996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317929.825323:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317930.529043:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317930.529056:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317930.529060:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317930.529065:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317930.529070:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317930.529081:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2830 00000100:00080000:1.0:1767317930.529092:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317930.529112:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317930.529126:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317930.529163:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291832320/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317930.529245:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291832448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317930.529546:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832320:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317930.534606:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317930.534634:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317930.534641:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317930.535758:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291832448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317930.785528:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317930.849463:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317931.810146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317931.873153:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317932.832991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317932.899106:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317933.857035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317933.921289:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317934.882008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317934.947065:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317935.649014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317935.649025:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317935.649029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317935.649034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317935.649039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317935.649051:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2835 00000100:00080000:1.0:1767317935.649064:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317935.649073:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317935.649098:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317935.649102:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317910/real 1767317910] req@ffff8c3c46ab0e00 x1853164291831168/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317935.649140:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291832576/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317935.649152:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0e00 x1853164291831168/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317935.649190:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317935.649221:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291832704:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317935.649435:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317935.649454:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317935.649460:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291831168:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767317935.652458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317935.652474:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317935.652479:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317935.652494:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2814 00000100:00080000:0.0:1767317935.652508:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317935.652517:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767317935.652583:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291832832/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317935.653571:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291832832:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767317935.674386:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291832704:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317935.677846:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317935.677869:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317935.677893:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317935.905198:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317935.969595:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317936.929625:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317936.993220:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317937.953246:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317938.017743:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317938.977352:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317939.041606:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317940.003974:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317940.065189:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317940.769702:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317940.769715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317940.769718:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317940.769743:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317940.769748:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317940.769760:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2840 00000100:00080000:1.0:1767317940.769773:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317940.769781:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317940.769793:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317940.769829:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291832960/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317940.769951:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291833088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317940.770291:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317940.777863:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291833088:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317940.779307:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317940.779318:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317940.779323:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291832960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317941.026371:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317941.089438:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317942.050495:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317942.113163:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317943.075076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317943.137716:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317944.097174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317944.161075:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317945.120954:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317945.185117:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317945.889055:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317945.889066:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317945.889069:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317945.889073:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317945.889078:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317945.889088:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2845 00000100:00080000:1.0:1767317945.889112:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317945.889119:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317945.889139:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317945.889174:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291833216/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317945.889299:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317945.889473:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291833344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317945.898936:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291833344:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317945.899867:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317945.899894:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317945.899899:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317946.146043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317946.210428:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317947.168989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317947.233058:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317948.193167:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317948.258351:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317949.217021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317949.281352:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317950.241018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317950.305226:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317951.009205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317951.009235:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317951.009239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317951.009243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317951.009247:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317951.009257:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2850 00000100:00080000:1.0:1767317951.009269:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317951.009277:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317951.009289:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317951.009684:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291833472/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317951.009744:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833472:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317951.009952:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317951.009963:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291833600:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767317951.014399:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291833600:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767317951.030153:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317951.030168:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317951.030173:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833472:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317951.265739:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317951.329259:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317952.289024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317952.353592:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317953.313899:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317953.377077:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317954.337361:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317954.404566:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317955.361017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317955.425598:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317956.133071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317956.133084:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317956.133087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317956.133091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317956.133104:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317956.133117:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2855 00000100:00080000:0.0:1767317956.133132:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317956.133141:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767317956.133156:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317956.133200:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291833728/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317956.133293:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317956.133314:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291833856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317956.133539:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833728:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767317956.140216:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317956.140234:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767317956.140240:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291833728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767317956.140786:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291833856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317956.385102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317956.450079:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317957.409010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317957.475135:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317958.435192:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317958.499100:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317959.457158:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317959.521502:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317960.225969:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317935/real 1767317935] req@ffff8c3c50e9f800 x1853164291832832/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317960.226027:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f800 x1853164291832832/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317960.226051:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317960.226075:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767317960.226080:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291832832:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767317960.226367:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317960.226373:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317960.226376:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317960.226382:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2840 00000100:00080000:1.0:1767317960.226392:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317960.226399:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767317960.226430:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291833984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317960.226468:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317960.226472:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317960.226474:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317960.226478:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2861 00000100:00080000:1.0:1767317960.226482:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317960.226486:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317960.226497:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317960.226509:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291834112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317960.226553:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317960.226569:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291834240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317960.227199:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291833984:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767317960.227264:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317960.251535:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291834240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317960.251771:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317960.251778:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317960.251782:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317960.480992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317960.546411:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317961.505298:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317961.569911:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317962.529040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317962.593251:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317963.553074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317963.617343:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317964.577191:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317964.641256:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317965.353412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317965.353427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317965.353431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317965.353436:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317965.353443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317965.353458:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2865 00000100:00080000:3.0:1767317965.353472:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317965.353480:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317965.353521:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317965.353835:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291834368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317965.354245:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291834496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317965.354663:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317965.380337:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317965.380359:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317965.380365:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317965.381314:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291834496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317965.603432:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317965.668061:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317966.626327:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317966.689166:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317967.649034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317967.714016:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317968.673159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317968.738107:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317969.697053:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317969.762170:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317970.465637:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317970.465653:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317970.465657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317970.465662:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317970.465669:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317970.465684:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2870 00000100:00080000:1.0:1767317970.465700:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317970.465735:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317970.465749:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317970.465787:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291834624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317970.465926:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291834752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317970.467283:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317970.469288:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291834752:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317970.473811:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317970.473835:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317970.473841:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317970.722041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317970.785599:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317971.745744:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317971.809094:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317972.769032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317972.833302:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317973.793029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317973.857151:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317974.816989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317974.881270:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317975.587578:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317975.587588:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317975.587592:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317975.587595:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317975.587599:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317975.587610:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2875 00000100:00080000:2.0:1767317975.587622:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317975.587642:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317975.587658:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317975.587704:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291834880/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317975.587785:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317975.587807:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291835008:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317975.588491:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317975.595536:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291835008:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317975.595551:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317975.595559:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317975.595564:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291834880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317975.841410:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317975.906256:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317976.865396:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317976.937549:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317977.889018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317977.958535:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317978.914414:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317978.978687:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317979.937327:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317980.003594:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317980.705061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317980.705074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317980.705077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317980.705081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317980.705086:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317980.705096:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2880 00000100:00080000:1.0:1767317980.705109:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317980.705116:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317980.705127:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317980.705162:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291835136/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317980.705245:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291835264:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317980.705790:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317980.709703:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291835264:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767317980.709810:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317980.709819:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317980.709823:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317980.962070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317981.025067:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317981.985332:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317982.049046:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317983.009025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317983.073328:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317984.033510:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317984.097978:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317985.057018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317985.121246:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317985.827306:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317960/real 1767317960] req@ffff8c3c46ab2a00 x1853164291833984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317985.827337:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2a00 x1853164291833984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317985.827357:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317985.827367:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767317985.827371:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291833984:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767317985.827838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317985.827850:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317985.827855:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317985.827865:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2865 00000100:00080000:3.0:1767317985.827909:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317985.827919:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767317985.827971:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291835392/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317985.828001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317985.828005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317985.828007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317985.828012:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2885 00000100:00080000:3.0:1767317985.828016:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317985.828019:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767317985.828030:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317985.828044:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291835520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317985.828061:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291835392:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767317985.828443:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317985.828831:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317985.828854:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291835648:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317985.843277:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317985.843295:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317985.843301:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317985.843314:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291835648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317986.082618:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317986.145183:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317987.105493:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317987.173265:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317988.128984:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317988.193129:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317989.153105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317989.217628:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317990.177094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317990.241883:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317990.945046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317990.945057:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317990.945060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317990.945064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317990.945095:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317990.945106:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2890 00000100:00080000:1.0:1767317990.945116:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317990.945124:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767317990.945136:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317990.945169:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291835776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317990.945245:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291835904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767317990.945254:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835776:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767317990.956974:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317990.956988:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767317990.956993:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291835776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767317990.957108:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291835904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317991.201004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317991.265500:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317992.225055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317992.295034:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317993.249244:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317993.314588:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317994.273100:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317994.341346:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317995.297217:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317995.361312:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317996.065755:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317996.065765:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317996.065768:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317996.065772:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317996.065777:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317996.065788:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2895 00000100:00080000:2.0:1767317996.065799:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317996.065806:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767317996.065838:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317996.065895:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291836032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317996.065962:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767317996.067071:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291836160:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767317996.071243:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317996.071260:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767317996.071267:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767317996.072849:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291836160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767317996.321008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317996.385301:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317997.345775:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767317997.415930:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317998.371204:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767317998.433368:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317999.393079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767317999.457041:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318000.418915:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318000.482353:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318001.185044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318001.185064:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318001.185067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318001.185071:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318001.185075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318001.185085:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2900 00000100:00080000:3.0:1767318001.185097:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318001.185104:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318001.185116:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318001.185151:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291836288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318001.185230:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318001.185248:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291836416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318001.185868:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836288:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318001.202707:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318001.202724:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318001.202730:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318001.206519:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291836416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318001.441039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318001.505031:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318002.465027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318002.529613:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318003.489443:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318003.553124:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318004.512989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318004.577193:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318005.541611:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318005.603422:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318006.305241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318006.305252:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318006.305255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318006.305260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318006.305264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318006.305274:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2906 00000100:00080000:1.0:1767318006.305285:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318006.305292:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318006.305303:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318006.305339:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291836544/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318006.305415:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291836672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318006.305602:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836544:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318006.323282:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318006.323308:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318006.323314:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318006.323695:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291836672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318006.561204:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318006.625184:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318007.585150:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318007.649231:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318008.609076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318008.673840:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318009.633195:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318009.698432:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318010.401083:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317985/real 1767317985] req@ffff8c3c58fc3800 x1853164291835392/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318010 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318010.401132:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3800 x1853164291835392/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318010.401154:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318010.401186:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318010.401228:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291835392:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318010.401330:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318010.401336:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318010.401338:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318010.401344:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2890 00000100:00080000:2.0:1767318010.401354:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318010.401360:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318010.401391:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291836800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318010.401428:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318010.401432:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318010.401434:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318010.401438:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2911 00000100:00080000:2.0:1767318010.401442:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318010.401446:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318010.401457:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318010.401469:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291836928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318010.401528:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318010.401542:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291837056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318010.402808:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291836800:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318010.402915:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318010.405283:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291837056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318010.407802:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318010.407818:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318010.407823:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291836928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318010.657004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318010.723586:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318011.681063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318011.746575:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318012.705054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318012.774205:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318013.729702:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318013.793992:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318014.753007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318014.817617:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318015.521079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318015.521107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318015.521114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318015.521121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318015.521128:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318015.521143:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2915 00000100:00080000:3.0:1767318015.521182:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318015.521192:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318015.521208:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318015.521273:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291837184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318015.521369:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318015.521371:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318015.521390:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291837312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318015.528296:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291837312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318015.528334:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318015.528349:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318015.528360:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318015.777150:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318015.841363:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318016.801970:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318016.865190:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318017.827045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318017.889564:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318018.853266:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318018.913371:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318019.873680:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318019.937128:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318020.641745:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318020.641756:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318020.641760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318020.641764:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318020.641768:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318020.641778:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2920 00000100:00080000:0.0:1767318020.641789:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318020.641796:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318020.641846:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318020.641926:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291837440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318020.642099:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291837568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318020.642239:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318020.650319:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291837568:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318020.650693:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318020.650701:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318020.650705:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318020.898132:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318020.962766:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318021.921724:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318021.986862:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318022.945005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318023.009138:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318023.969016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318024.035151:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318024.992994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318025.060330:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318025.761159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318025.761171:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318025.761175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318025.761178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318025.761183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318025.761194:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2925 00000100:00080000:3.0:1767318025.761205:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318025.761212:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318025.761225:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318025.761284:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291837696/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318025.761432:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291837824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318025.762305:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318025.767218:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291837824:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318025.767547:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318025.767555:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318025.767559:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318026.017046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318026.081202:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318027.041007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318027.105518:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318028.065318:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318028.129327:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318029.089089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318029.153246:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318030.112953:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318030.181816:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318030.881025:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318030.881037:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318030.881040:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318030.881044:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318030.881068:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318030.881081:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2930 00000100:00080000:3.0:1767318030.881094:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318030.881101:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318030.881114:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318030.881155:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291837952/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318030.881414:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291838080:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318030.881800:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318030.889812:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291838080:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318030.890005:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318030.890011:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318030.890014:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291837952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318031.137292:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318031.206385:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318032.161030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318032.230037:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318033.185339:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318033.249245:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318034.209125:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318034.273389:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318035.233201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318035.297190:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318036.001055:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318010/real 1767318010] req@ffff8c3c5a28b100 x1853164291836800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318036.001101:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b100 x1853164291836800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318036.001198:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318036.001217:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318036.001223:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291836800:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318036.001469:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318036.001479:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318036.001482:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318036.001492:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2915 00000100:00080000:3.0:1767318036.001504:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318036.001512:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318036.001551:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291838208/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318036.001672:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318036.001676:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318036.001678:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318036.001683:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2935 00000100:00080000:3.0:1767318036.001687:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318036.001691:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318036.001702:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318036.001715:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291838336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318036.002136:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291838208:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318036.002238:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318036.002925:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291838464:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318036.005605:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318036.005619:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318036.005625:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318036.009841:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291838464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318036.257013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318036.321060:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318037.281103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318037.345477:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318038.305016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318038.369247:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318039.328979:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318039.394057:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318040.353835:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318040.417515:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318041.121546:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318041.121557:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318041.121560:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318041.121564:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318041.121569:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318041.121580:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2940 00000100:00080000:3.0:1767318041.121591:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318041.121597:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318041.121608:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318041.121668:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291838592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318041.121798:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318041.121951:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291838720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318041.132675:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291838720:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318041.135341:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318041.135356:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318041.135361:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318041.377055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318041.441679:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318042.401698:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318042.465332:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318043.425040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318043.489123:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318044.449209:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318044.518367:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318045.473075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318045.537912:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318046.241003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318046.241013:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318046.241017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318046.241020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318046.241025:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318046.241036:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2946 00000100:00080000:3.0:1767318046.241048:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318046.241055:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318046.241067:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318046.241103:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291838848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318046.241208:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291838976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318046.241898:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318046.244848:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291838976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318046.253590:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318046.253620:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318046.253625:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291838848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318046.497039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318046.561091:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318047.521052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318047.586119:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318048.545008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318048.609119:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318049.569129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318049.634371:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318050.593305:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318050.657734:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318051.361021:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318051.361034:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318051.361038:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318051.361042:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318051.361047:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318051.361057:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2951 00000100:00080000:3.0:1767318051.361068:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318051.361075:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318051.361088:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318051.361124:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291839104/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318051.361215:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318051.361232:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291839232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318051.363131:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839104:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318051.369221:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318051.369251:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318051.369258:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318051.370406:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291839232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318051.617103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318051.682312:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318052.642452:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318052.705134:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318053.665076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318053.732377:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318054.689904:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318054.753033:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318055.713271:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318055.777160:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318056.483244:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318056.483255:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318056.483279:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318056.483284:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318056.483289:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318056.483299:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2956 00000100:00080000:1.0:1767318056.483311:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318056.483319:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318056.483331:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318056.483366:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291839360/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318056.483464:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318056.483510:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291839488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318056.484921:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839360:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318056.488377:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318056.488395:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318056.488402:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839360:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318056.490735:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291839488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318056.739243:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318056.801492:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318057.761093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318057.826137:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318058.786960:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318058.849101:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318059.809142:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318059.873405:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318060.833152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318060.897431:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318061.601032:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318036/real 1767318036] req@ffff8c3c58fc2a00 x1853164291838208/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318061.601071:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2a00 x1853164291838208/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318061.601091:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318061.601115:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318061.601119:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291838208:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318061.601229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318061.601235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318061.601239:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318061.601244:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2940 00000100:00080000:1.0:1767318061.601263:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318061.601270:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767318061.601303:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291839616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318061.601325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318061.601344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318061.601346:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318061.601350:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2961 00000100:00080000:1.0:1767318061.601353:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318061.601357:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318061.601368:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318061.601377:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291839744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318061.601444:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318061.601458:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291839872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318061.601607:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291839616:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318061.605146:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318061.621374:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291839872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318061.622111:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318061.622134:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318061.622139:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291839744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318061.857766:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318061.921464:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318062.881023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318062.945350:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318063.905613:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318063.969068:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318064.929009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318064.994866:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318065.953794:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318066.026171:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318066.721425:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318066.721440:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318066.721443:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318066.721447:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318066.721453:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318066.721465:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2966 00000100:00080000:1.0:1767318066.721480:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318066.721489:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318066.721503:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318066.721575:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291840000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318066.721669:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318066.721687:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291840128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318066.722410:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840000:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318066.734886:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318066.734907:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318066.734913:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318066.740322:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291840128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318066.978107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318067.041254:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318068.001096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318068.070542:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318069.025120:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318069.089547:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318070.049010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318070.114337:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318071.073376:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318071.137542:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318071.843286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318071.843296:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318071.843300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318071.843304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318071.843311:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318071.843322:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2971 00000100:00080000:0.0:1767318071.843348:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318071.843360:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318071.843374:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318071.843429:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291840256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318071.843502:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318071.843518:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291840384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318071.843984:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840256:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318071.851787:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318071.851813:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318071.851819:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318071.852052:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291840384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318072.097371:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318072.161501:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318073.121036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318073.185164:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318074.147445:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318074.211608:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318075.169040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318075.233824:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318076.193034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318076.257470:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318076.962815:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318076.962828:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318076.962832:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318076.962835:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318076.962841:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318076.962853:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2976 00000100:00080000:3.0:1767318076.962865:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318076.962911:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318076.962924:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318076.962970:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291840512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318076.963053:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318076.963071:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291840640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318076.963538:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318076.965277:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291840640:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318076.967472:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318076.967486:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318076.967491:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318077.216994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318077.283285:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318078.241446:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318078.306239:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318079.268555:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318079.331393:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318080.289001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318080.353431:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318081.313063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318081.379347:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318082.081394:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318082.081406:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318082.081410:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318082.081414:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318082.081419:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318082.081430:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2981 00000100:00080000:0.0:1767318082.081442:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318082.081449:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318082.081462:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318082.081501:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291840768/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318082.081581:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291840896:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318082.081586:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318082.086118:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291840896:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318082.086356:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318082.086392:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318082.086398:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291840768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318082.337093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318082.401619:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318083.361061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318083.426498:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318084.385296:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318084.454746:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318085.409085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318085.473405:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318086.177201:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318061/real 1767318061] req@ffff8c3c46ab0700 x1853164291839616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318086 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318086.177248:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0700 x1853164291839616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318086 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318086.177279:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318086.177311:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318086.177316:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291839616:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318086.179624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318086.179635:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318086.179640:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318086.179652:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2966 00000100:00080000:0.0:1767318086.179664:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318086.179671:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318086.179707:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291841024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318086.179737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318086.179755:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318086.179758:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318086.179762:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2986 00000100:00080000:0.0:1767318086.179767:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318086.179771:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318086.179783:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318086.179796:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291841152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318086.179853:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291841024:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318086.180016:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318086.180051:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318086.180067:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291841280:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318086.185069:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318086.185086:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318086.185092:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318086.189022:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291841280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318086.435644:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318086.497235:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318087.457098:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318087.524563:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318088.480997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318088.546535:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318089.507307:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318089.571225:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318090.529917:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318090.593098:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318091.297226:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318091.297236:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318091.297239:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318091.297242:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318091.297246:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318091.297256:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2991 00000100:00080000:3.0:1767318091.297269:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318091.297277:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318091.297291:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318091.297328:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291841408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318091.297526:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318091.297541:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291841536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318091.297661:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841408:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318091.305925:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318091.305942:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318091.305948:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318091.306930:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291841536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318091.553466:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318091.617649:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318092.577277:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318092.641200:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318093.601793:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318093.665163:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318094.625020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318094.691836:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318095.649114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318095.713231:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318096.417143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318096.417159:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318096.417162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318096.417177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318096.417209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318096.417227:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 2996 00000100:00080000:1.0:1767318096.417243:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318096.417253:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318096.417271:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318096.417317:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291841664/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318096.417413:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318096.417431:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291841792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318096.418007:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318096.429196:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291841792:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318096.429386:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318096.429394:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318096.429397:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318096.673050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318096.738758:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318097.699159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318097.764695:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318098.721557:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318098.787494:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318099.745202:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318099.809309:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318100.769047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318100.833154:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318101.537902:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318101.537921:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318101.537924:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318101.537929:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318101.537935:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318101.537950:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3001 00000100:00080000:3.0:1767318101.538001:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318101.538009:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318101.538024:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318101.538087:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291841920/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318101.538217:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291842048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318101.538950:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841920:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318101.547146:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318101.547167:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318101.547173:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291841920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318101.548128:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291842048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318101.793107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318101.857422:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318102.817036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318102.881173:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318103.841077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318103.907244:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318104.870717:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318104.929376:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318105.889016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318105.954225:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318106.658986:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318106.659001:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318106.659004:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318106.659010:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318106.659016:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318106.659037:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3006 00000100:00080000:3.0:1767318106.659050:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318106.659059:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318106.659074:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318106.659117:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291842176/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318106.661330:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291842304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318106.661536:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842176:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318106.673806:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318106.673826:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318106.673832:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842176:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318106.673915:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291842304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318106.913208:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318106.977101:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318107.937097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318108.001909:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318108.961150:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318109.028320:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318109.986962:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318110.049199:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318111.010592:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318111.073168:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318111.778700:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318086/real 1767318086] req@ffff8c3c50e9ca80 x1853164291841024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318111.778748:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ca80 x1853164291841024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318111.778774:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318111.778811:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318111.778816:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291841024:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318111.779185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318111.779192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318111.779196:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318111.779202:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 2991 00000100:00080000:1.0:1767318111.779215:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318111.779223:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767318111.779268:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291842432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318111.779307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318111.779311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318111.779313:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318111.779317:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3011 00000100:00080000:1.0:1767318111.779321:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318111.779324:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318111.779336:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318111.779347:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291842560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318111.779449:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291842688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318111.779595:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291842432:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318111.779631:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318111.784830:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291842688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318111.805344:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318111.805378:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318111.805385:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318112.033336:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318112.099372:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318113.058165:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318113.121839:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318114.081311:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318114.147838:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318115.105336:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318115.169635:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318116.129199:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318116.193684:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318116.897249:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318116.897264:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318116.897267:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318116.897281:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318116.897286:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318116.897300:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3016 00000100:00080000:3.0:1767318116.897323:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318116.897357:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318116.897372:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318116.897420:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291842816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318116.897509:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291842944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318116.897788:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842816:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318116.914960:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318116.914985:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318116.914991:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291842816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318116.915141:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291842944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318117.153139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318117.223868:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318118.177114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318118.241176:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318119.201273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318119.268695:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318120.225038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318120.289179:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318121.249046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318121.313076:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318122.017074:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318122.017088:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318122.017091:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318122.017096:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318122.017111:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318122.017123:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3021 00000100:00080000:3.0:1767318122.017136:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318122.017144:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318122.017159:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318122.017202:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291843072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318122.017275:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318122.017298:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291843200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318122.020662:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843072:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318122.024345:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318122.024365:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318122.024372:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318122.024685:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291843200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318122.273055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318122.337183:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318123.297154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318123.361661:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318124.321166:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318124.388249:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318125.345047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318125.409121:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318126.369006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318126.433218:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318127.137090:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318127.137100:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318127.137104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318127.137107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318127.137112:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318127.137122:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3026 00000100:00080000:1.0:1767318127.137133:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318127.137140:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318127.137151:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318127.137186:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291843328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318127.137276:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318127.137297:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291843456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318127.137301:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843328:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318127.144848:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318127.144864:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318127.144897:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318127.148647:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291843456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318127.393220:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318127.457125:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318128.417008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318128.481112:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318129.442020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318129.505148:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318130.467252:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318130.531340:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318131.489023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318131.553552:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318132.257028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318132.257039:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318132.257042:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318132.257046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318132.257051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318132.257061:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3032 00000100:00080000:1.0:1767318132.257072:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318132.257079:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318132.257091:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318132.257123:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291843584/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318132.257199:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318132.257212:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291843712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318132.257261:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843584:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318132.267539:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318132.267559:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318132.267563:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318132.268377:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291843712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318132.513318:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318132.580264:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318133.537101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318133.601109:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318134.561305:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318134.626401:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318135.585006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318135.649337:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318136.361416:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318111/real 1767318111] req@ffff8c3c46ab1500 x1853164291842432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318136.361452:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab1500 x1853164291842432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318136.361473:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318136.361501:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318136.361506:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291842432:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318136.361608:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318136.361614:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318136.361617:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318136.361627:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3016 00000100:00080000:3.0:1767318136.361649:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318136.361656:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318136.361690:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291843840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318136.361713:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318136.361716:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318136.361719:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318136.361723:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3037 00000100:00080000:3.0:1767318136.361725:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318136.361729:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318136.361738:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318136.361747:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291843968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318136.361813:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318136.361826:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291844096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318136.362314:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291843840:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318136.362353:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318136.369843:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291844096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318136.369953:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318136.369969:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318136.369976:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291843968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318136.612024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318136.673757:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318137.633044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318137.698133:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318138.657012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318138.722276:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318139.681162:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318139.745181:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318140.705036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318140.769422:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318141.474647:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318141.474658:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318141.474661:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318141.474665:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318141.474669:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318141.474679:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3041 00000100:00080000:3.0:1767318141.474732:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318141.474741:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318141.474755:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318141.474791:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291844224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318141.474962:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318141.474980:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291844352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318141.475758:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318141.478348:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291844352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318141.487396:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318141.487418:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318141.487424:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318141.730411:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318141.794386:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318142.753253:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318142.818489:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318143.777619:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318143.841729:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318144.801175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318144.865620:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318145.826210:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318145.895327:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318146.592986:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318146.592996:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318146.592999:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318146.593003:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318146.593007:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318146.593018:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3046 00000100:00080000:3.0:1767318146.593029:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318146.593037:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318146.593048:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318146.593084:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291844480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318146.593146:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318146.593165:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318146.593186:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291844608:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318146.597504:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318146.597527:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318146.597533:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318146.597652:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291844608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318146.849030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318146.915365:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318147.872990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318147.938722:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318148.897142:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318148.961781:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318149.927130:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318149.985599:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318150.945753:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318151.014137:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318151.713243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318151.713301:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318151.713305:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318151.713309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318151.713316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318151.713329:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3051 00000100:00080000:0.0:1767318151.713345:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767318151.713355:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318151.713372:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318151.713428:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291844736/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318151.713524:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318151.713546:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291844864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318151.714311:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318151.717599:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291844864:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318151.737994:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318151.738016:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318151.738043:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318151.970175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318152.037431:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318152.996162:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318153.058689:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318154.017273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318154.081263:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318155.041699:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318155.106928:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318156.066720:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318156.129167:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318156.836283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318156.836299:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318156.836303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318156.836314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318156.836320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318156.836333:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3056 00000100:00080000:0.0:1767318156.836373:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1767318156.836382:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318156.836398:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318156.836441:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291844992/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318156.836540:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318156.836562:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291845120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318156.837710:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844992:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318156.841801:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318156.841823:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318156.841830:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291844992:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318156.846173:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291845120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318157.090216:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318157.155939:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318158.113072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318158.178546:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318159.138707:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318159.202219:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318160.161609:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318160.225347:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318161.185816:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318161.251112:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318161.953899:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318136/real 1767318136] req@ffff8c3c58fc0380 x1853164291843840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318161.953935:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0380 x1853164291843840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318161.953958:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318161.953972:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318161.953976:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291843840:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318161.954774:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318161.954811:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318161.954816:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318161.954826:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3041 00000100:00080000:3.0:1767318161.954840:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318161.954849:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318161.954915:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291845248/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318161.954948:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318161.954952:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318161.954954:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318161.954958:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3061 00000100:00080000:3.0:1767318161.954964:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1767318161.954968:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318161.954980:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318161.954995:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291845376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318161.955072:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291845504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318161.955092:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291845248:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318161.955232:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318161.960768:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291845504:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318161.960801:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318161.960812:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318161.960817:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318162.209047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318162.273979:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318163.233213:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318163.297791:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318164.257192:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318164.322019:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318165.281117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318165.345217:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318166.305080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318166.369144:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318167.073215:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318167.073231:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318167.073235:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318167.073267:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318167.073272:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318167.073286:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3066 00000100:00080000:3.0:1767318167.073302:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318167.073312:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318167.073329:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318167.073390:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291845632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318167.073479:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318167.073499:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291845760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318167.075025:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845632:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318167.083746:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318167.083785:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318167.083792:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318167.083933:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291845760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318167.329085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318167.394804:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318168.353096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318168.417593:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318169.377226:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318169.441186:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318170.401203:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318170.465208:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318171.427846:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318171.489341:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318172.193381:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318172.193393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318172.193397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318172.193401:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318172.193407:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318172.193420:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3071 00000100:00080000:3.0:1767318172.193443:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318172.193454:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318172.193469:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318172.193576:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291845888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318172.198533:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318172.202794:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318172.202838:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846016:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318172.211541:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318172.211569:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318172.211577:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291845888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318172.214527:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318172.449121:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318172.514751:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318173.473007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318173.537477:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318174.497075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318174.562530:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318175.522034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318175.585294:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318176.545049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318176.609678:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318177.316664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318177.316678:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318177.316681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318177.316686:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318177.316692:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318177.316731:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3077 00000100:00080000:2.0:1767318177.316744:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318177.316754:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318177.316769:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318177.316813:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291846144/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318177.316945:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318177.316969:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291846272:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318177.320641:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318177.321292:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291846272:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318177.331797:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318177.331822:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318177.331830:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318177.569158:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318177.633180:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318178.593028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318178.657531:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318179.617598:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318179.683285:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318180.641045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318180.705685:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318181.665238:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318181.729580:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318182.434404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318182.434415:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318182.434418:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318182.434422:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318182.434426:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318182.434436:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3082 00000100:00080000:2.0:1767318182.434448:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318182.434456:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318182.434469:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318182.435668:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291846400/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318182.435829:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846400:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318182.436032:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318182.436045:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846528:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318182.446410:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846528:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318182.449460:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318182.449961:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318182.449968:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846400:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318182.689059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318182.754821:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318183.713195:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318183.777702:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318184.737060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318184.801426:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318185.761028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318185.825946:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318186.529090:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318161/real 1767318161] req@ffff8c3c58fc2680 x1853164291845248/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318186.529143:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291845248/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318186.529175:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318186.529202:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318186.529208:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291845248:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318186.529664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318186.529673:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318186.529678:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318186.529685:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3066 00000100:00080000:2.0:1767318186.529699:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318186.529707:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318186.529757:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291846656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318186.529788:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1767318186.529832:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291846656:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318186.530735:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318186.530740:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318186.530747:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3087 00000100:00080000:2.0:1767318186.530754:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318186.530760:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318186.530771:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318186.530900:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291846784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318186.531147:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318186.532643:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318186.551138:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291846912:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318186.551171:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318186.551189:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318186.551195:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291846784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318186.785166:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318186.849317:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318187.809166:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318187.877460:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318188.833091:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318188.897509:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318189.858443:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318189.921791:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318190.881983:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318190.945274:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318191.649047:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318191.649060:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318191.649064:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318191.649068:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318191.649073:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318191.649086:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3091 00000100:00080000:1.0:1767318191.649097:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318191.649104:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318191.649117:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318191.649156:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291847040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318191.649262:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318191.649275:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291847168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318191.649658:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847040:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318191.654690:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318191.654708:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318191.654730:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318191.654945:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291847168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318191.905020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318191.969070:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318192.929034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318192.993206:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318193.953029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318194.017079:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318194.980017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318195.046643:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318196.001144:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318196.068082:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318196.776350:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318196.776362:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318196.776366:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318196.776370:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318196.776373:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318196.776393:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3096 00000100:00080000:1.0:1767318196.776406:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318196.776414:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318196.776428:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318196.776463:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291847296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318196.776553:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291847424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318196.780535:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318196.788006:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291847424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318196.794027:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318196.794042:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318196.794047:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318197.025457:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318197.089120:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318198.050492:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318198.113219:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318199.073260:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318199.137610:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318200.098961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318200.161353:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318201.124908:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318201.185120:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318201.889223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318201.889235:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318201.889238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318201.889243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318201.889247:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318201.889260:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3101 00000100:00080000:2.0:1767318201.889272:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318201.889279:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318201.889291:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318201.889323:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291847552/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318201.889525:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318201.890665:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291847680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318201.905849:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291847680:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318201.906182:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318201.906212:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318201.906216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318202.145273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318202.212964:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318203.169221:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318203.233279:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318204.193183:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318204.258310:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318205.217813:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318205.281191:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318206.241127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318206.305346:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318207.009437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318207.009448:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318207.009450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318207.009454:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318207.009458:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318207.009469:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3106 00000100:00080000:0.0:1767318207.009501:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318207.009509:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318207.009521:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318207.009555:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291847808/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318207.009627:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291847936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318207.010305:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318207.013028:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291847936:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318207.015099:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318207.015126:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318207.015132:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291847808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318207.268138:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318207.329436:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318208.290513:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318208.353485:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318209.313111:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318209.377236:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318210.337007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318210.401064:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318211.105937:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318186/real 1767318186] req@ffff8c3c5a28b100 x1853164291846656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318211.105974:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b100 x1853164291846656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318211.105994:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318211.106010:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318211.106014:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291846656:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318211.106132:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318211.106139:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318211.106142:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318211.106148:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3091 00000100:00080000:0.0:1767318211.106157:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318211.106164:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318211.106199:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291848064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318211.106234:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318211.106237:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318211.106239:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318211.106243:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3111 00000100:00080000:0.0:1767318211.106247:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318211.106268:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318211.106278:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318211.106292:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291848192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318211.106358:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291848320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318211.106721:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291848064:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318211.106754:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848192:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318211.111765:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318211.111781:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318211.111800:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318211.112744:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291848320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318211.361125:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318211.425172:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318212.385017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318212.449104:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318213.409035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318213.473136:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318214.433568:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318214.497198:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318215.457277:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318215.522730:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318216.225713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318216.225724:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318216.225728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318216.225731:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318216.225736:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318216.225745:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3115 00000100:00080000:3.0:1767318216.225755:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318216.225779:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318216.225790:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318216.225825:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291848448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318216.225901:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318216.226090:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291848576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318216.238033:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291848576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318216.240593:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318216.240607:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318216.240612:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318216.481051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318216.546605:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318217.505117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318217.569896:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318218.529235:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318218.595397:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318219.555921:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318219.625517:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318220.577116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318220.645045:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318221.351169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318221.351187:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318221.351193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318221.351197:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318221.351203:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318221.351216:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3121 00000100:00080000:2.0:1767318221.351232:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318221.351242:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318221.351256:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318221.351306:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291848704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318221.351473:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318221.351498:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291848832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318221.352241:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318221.377793:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291848832:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318221.380238:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318221.380254:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318221.380259:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318221.601268:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318221.669041:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318222.624983:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318222.693389:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318223.649489:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318223.717896:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318224.673865:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318224.737538:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318225.697270:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318225.761894:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318226.469484:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318226.469496:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318226.469499:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318226.469502:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318226.469507:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318226.469517:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3126 00000100:00080000:0.0:1767318226.469529:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318226.469536:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318226.469550:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318226.469584:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291848960/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318226.469654:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291849088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318226.469894:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318226.473723:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291849088:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318226.473942:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318226.473948:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318226.473953:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291848960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318226.723277:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318226.785235:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318227.745118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318227.812364:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318228.770095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318228.833086:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318229.793026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318229.858231:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318230.817011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318230.885807:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318231.585469:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318231.585482:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318231.585485:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318231.585489:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318231.585495:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318231.585507:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3131 00000100:00080000:0.0:1767318231.585520:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318231.585530:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318231.585546:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318231.585586:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291849216/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318231.585696:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291849344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318231.585779:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318231.590618:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291849344:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318231.591194:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318231.591203:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318231.591207:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318231.841009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318231.915499:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318232.865074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318232.930861:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318233.889227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318233.956382:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318234.913545:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318234.977119:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318235.938010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318236.001151:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318236.705064:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318211/real 1767318211] req@ffff8c3c50e9f100 x1853164291848064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318236 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318236.705110:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f100 x1853164291848064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318236 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318236.705131:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318236.705144:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318236.705149:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291848064:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318236.705290:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318236.705296:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318236.705300:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318236.705315:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3115 00000100:00080000:1.0:1767318236.705325:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318236.705331:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767318236.705360:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164291849472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318236.705385:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318236.705389:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318236.705391:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318236.705395:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3136 00000100:00080000:1.0:1767318236.705399:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318236.705404:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318236.705415:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318236.705417:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291849472:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318236.705431:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291849600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318236.705504:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291849728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318236.705513:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318236.713681:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318236.713696:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318236.713701:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318236.715482:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291849728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318236.961216:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318237.028388:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318237.985075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318238.049587:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318239.009259:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318239.077203:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318240.033013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318240.097126:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318241.057025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318241.123014:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318241.825120:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318241.825132:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318241.825135:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318241.825139:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318241.825144:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318241.825156:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3141 00000100:00080000:0.0:1767318241.825189:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318241.825196:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318241.825210:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318241.825242:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291849856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318241.825366:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291849984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318241.829362:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318241.829369:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291849984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318241.841236:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318241.841251:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318241.841257:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291849856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318242.080973:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318242.148200:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318243.105547:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318243.170557:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318244.129146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318244.193092:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318245.153015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318245.217154:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318246.177057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318246.241367:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318246.945697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318246.945708:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318246.945732:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318246.945736:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318246.945740:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318246.945760:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3146 00000100:00080000:3.0:1767318246.945773:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318246.945780:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318246.945794:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318246.945833:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291850112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318246.945969:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318246.945986:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291850240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318246.946663:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850112:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318246.955382:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318246.955398:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318246.955403:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318246.955505:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291850240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318247.201122:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318247.267246:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318248.225230:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318248.290181:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318249.248992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318249.316013:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318250.273074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318250.337892:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318251.297130:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318251.365775:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318252.065136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318252.065146:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318252.065149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318252.065153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318252.065157:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318252.065178:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3151 00000100:00080000:3.0:1767318252.065190:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318252.065197:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318252.065209:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318252.065246:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291850368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318252.065334:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318252.065372:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291850496:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318252.078657:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318252.078672:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318252.078678:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318252.078800:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291850496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318252.323052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318252.385205:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318253.345323:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318253.409331:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318254.370494:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318254.437302:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318255.393010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318255.458727:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318256.417101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318256.481240:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318257.188437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318257.188452:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318257.188455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318257.188460:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318257.188466:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318257.188481:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3156 00000100:00080000:2.0:1767318257.188497:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318257.188508:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318257.188524:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318257.188587:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291850624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318257.188821:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318257.188842:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291850752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318257.210735:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291850752:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318257.211182:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318257.211190:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318257.211194:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291850624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318257.441620:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318257.505526:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318258.465052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318258.529323:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318259.489103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318259.558809:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318260.514232:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318260.577445:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318261.281009:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318236/real 1767318236] req@ffff8c3c46ab2d80 x1853164291849472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318261.281043:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2d80 x1853164291849472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318261.281062:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318261.281093:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767318261.281098:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291849472:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318261.281192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318261.281197:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318261.281199:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318261.281204:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3141 00000100:00080000:2.0:1767318261.281213:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318261.281220:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318261.281250:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291850880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318261.281293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318261.281296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318261.281298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318261.281302:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3162 00000100:00080000:2.0:1767318261.281306:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318261.281310:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318261.281445:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318261.281460:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291851008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318261.281507:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291851136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318261.281638:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291850880:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318261.283679:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851008:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318261.291816:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318261.291831:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318261.291837:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318261.291939:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291851136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318261.537239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318261.601115:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318262.561457:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318262.625242:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318263.585042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318263.652248:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318264.609184:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318264.673510:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318265.633383:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318265.699022:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318266.401772:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318266.401789:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318266.401792:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318266.401797:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318266.401803:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318266.401817:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3166 00000100:00080000:0.0:1767318266.401834:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318266.401843:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318266.401984:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318266.402027:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291851264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318266.402120:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318266.405118:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291851392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318266.421131:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291851392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318266.423889:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318266.423962:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318266.423970:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318266.657129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318266.721316:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318267.681086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318267.745531:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318268.705701:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318268.769900:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318269.736227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318269.793578:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318270.757384:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318270.818321:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318271.521134:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318271.521150:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318271.521153:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318271.521158:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318271.521164:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318271.521181:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3171 00000100:00080000:1.0:1767318271.521199:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318271.521209:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318271.521227:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318271.521285:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291851520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318271.521386:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318271.521408:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291851648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318271.522721:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318271.524285:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291851648:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318271.531455:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318271.531478:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318271.531484:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318271.777728:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318271.841496:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318272.802042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318272.872699:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318273.825034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318273.895561:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318274.849068:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318274.913950:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318275.874131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318275.937515:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318276.641113:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318276.641129:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318276.641133:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318276.641137:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318276.641143:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318276.641156:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3176 00000100:00080000:0.0:1767318276.641171:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318276.641181:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318276.641197:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318276.641250:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291851776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318276.641339:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318276.641364:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291851904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318276.642533:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318276.644809:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291851904:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318276.652590:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318276.652615:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318276.652622:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291851776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318276.898924:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318276.961163:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318277.921558:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318277.985154:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318278.945332:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318279.009312:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318279.969408:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318280.033268:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318280.994424:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318281.057226:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318281.761279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318281.761311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318281.761314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318281.761319:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318281.761323:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318281.761335:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3181 00000100:00080000:1.0:1767318281.761348:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318281.761356:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318281.761370:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318281.761403:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291852032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318281.761507:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291852160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318281.761701:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318281.779768:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291852160:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318281.779915:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318281.779934:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318281.779938:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318282.017124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318282.081156:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318283.041233:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318283.107742:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318284.065261:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318284.132319:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318285.089200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318285.158106:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318286.118861:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318286.177198:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318286.882989:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318261/real 1767318261] req@ffff8c3c5a289f80 x1853164291850880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318286.883032:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289f80 x1853164291850880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318286.883056:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318286.890681:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318286.890702:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291850880:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318286.891322:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318286.891331:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318286.891337:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318286.891345:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3166 00000100:00080000:3.0:1767318286.891360:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318286.891368:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318286.891445:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291852288/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318286.892345:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318286.892351:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318286.892355:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318286.892362:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3186 00000100:00080000:3.0:1767318286.892369:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318286.892375:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318286.892397:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318286.892425:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291852416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318286.892603:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291852288:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318286.892756:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318286.896427:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291852544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318286.899347:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318286.899368:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318286.899375:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318286.900841:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291852544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318287.138183:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318287.201267:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318288.161028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318288.225311:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318289.185066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318289.251383:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318290.209044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318290.273475:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318291.233064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318291.297163:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318292.002324:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318292.002347:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318292.002351:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318292.002355:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318292.002361:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318292.002374:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3191 00000100:00080000:1.0:1767318292.002389:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318292.002398:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318292.002413:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318292.002463:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291852672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318292.002602:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318292.002913:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291852800:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318292.011072:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318292.011095:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318292.011101:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318292.011267:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291852800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318292.257256:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318292.321597:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318293.281919:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318293.345432:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318294.305524:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318294.371330:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318295.329207:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318295.393164:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318296.353595:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318296.418048:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318297.121140:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318297.121160:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318297.121164:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318297.121168:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318297.121174:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318297.121191:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3196 00000100:00080000:1.0:1767318297.121222:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318297.121232:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318297.121258:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318297.121325:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291852928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318297.121516:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318297.121556:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291853056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318297.139228:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318297.139252:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318297.139260:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291852928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318297.148530:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291853056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318297.377286:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318297.441414:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318298.402320:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318298.465253:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318299.425213:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318299.489129:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318300.448969:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318300.513305:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318301.473030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318301.538768:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318302.241118:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318302.241128:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318302.241131:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318302.241135:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318302.241140:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318302.241151:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3202 00000100:00080000:1.0:1767318302.241161:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318302.241168:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318302.241181:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318302.241218:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291853184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318302.241300:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291853312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318302.241484:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318302.248788:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291853312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318302.249073:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318302.249081:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318302.249085:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318302.497232:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318302.561224:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318303.521123:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318303.585301:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318304.545069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318304.609211:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318305.570453:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318305.633161:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318306.594634:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318306.660636:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318307.361174:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318307.361184:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318307.361187:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318307.361191:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318307.361195:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318307.361215:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3207 00000100:00080000:3.0:1767318307.361226:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318307.361233:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318307.361245:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318307.361281:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291853440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318307.361355:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318307.361368:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291853568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318307.361534:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853440:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318307.372708:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318307.372718:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318307.372723:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318307.372987:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291853568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318307.617008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318307.690721:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318308.641817:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318308.705163:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318309.665000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318309.729378:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318310.689140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318310.753126:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318311.457854:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318286/real 1767318286] req@ffff8c3c58fc2680 x1853164291852288/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318311 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318311.457939:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291852288/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318311 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318311.457964:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318311.457983:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767318311.457988:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291852288:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318311.460333:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318311.460348:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318311.460353:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318311.460366:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3191 00000100:00080000:0.0:1767318311.460381:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318311.460431:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318311.460481:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291853696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318311.460521:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318311.460525:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318311.460526:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318311.460530:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3212 00000100:00080000:0.0:1767318311.460534:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318311.460538:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318311.460549:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318311.460563:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291853824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318311.460816:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291853952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318311.461107:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291853696:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318311.461197:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318311.473260:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291853952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318311.479598:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318311.479620:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318311.479627:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291853824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318311.713060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318311.778327:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318312.737180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318312.801190:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318313.761057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318313.826824:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318314.787487:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318314.849145:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318315.809103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318315.877040:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318316.577580:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318316.577595:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318316.577598:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318316.577603:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318316.577610:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318316.577624:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3216 00000100:00080000:2.0:1767318316.577640:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318316.577649:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318316.577675:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318316.577730:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291854080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318316.577844:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291854208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318316.578771:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318316.590729:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291854208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318316.590954:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318316.590962:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318316.590966:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318316.833007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318316.898030:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318317.856972:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318317.921226:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318318.880985:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318318.945155:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318319.905009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318319.969232:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318320.929008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318320.993263:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318321.697214:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318321.697227:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318321.697231:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318321.697235:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318321.697240:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318321.697253:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3221 00000100:00080000:2.0:1767318321.697267:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318321.697278:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318321.697294:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318321.697338:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291854336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318321.697495:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318321.698146:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291854464:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318321.700719:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318321.700742:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318321.700758:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318321.701218:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291854464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318321.953015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318322.019634:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318322.978341:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318323.041188:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318324.001014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318324.065116:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318325.025159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318325.089638:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318326.049137:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318326.113242:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318326.817833:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318326.817845:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318326.817848:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318326.817853:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318326.817857:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318326.817868:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3226 00000100:00080000:0.0:1767318326.817912:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318326.818110:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318326.818123:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318326.818153:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291854592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318326.818584:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291854720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318326.820868:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854592:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318326.830367:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318326.830386:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318326.830392:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318326.836362:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291854720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318327.073057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318327.137185:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318328.098229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318328.161137:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318329.121128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318329.185202:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318330.145519:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318330.209149:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318331.169109:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318331.236829:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318331.941090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318331.941101:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318331.941105:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318331.941109:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318331.941112:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318331.941123:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3231 00000100:00080000:3.0:1767318331.941134:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318331.941170:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318331.941183:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318331.941217:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291854848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318331.941305:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318331.943112:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318331.943187:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291854976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318331.946229:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318331.946243:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318331.946248:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291854848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318331.951044:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291854976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318332.193050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318332.257145:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318333.217119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318333.281171:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318334.241753:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318334.305144:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318335.265029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318335.330246:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318336.033461:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318311/real 1767318311] req@ffff8c3c50e9ce00 x1853164291853696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318336 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318336.033506:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ce00 x1853164291853696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318336 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318336.033538:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318336.033593:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318336.033608:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291853696:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318336.034500:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318336.034507:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318336.034511:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318336.034518:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3216 00000100:00080000:2.0:1767318336.034536:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318336.034543:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318336.034580:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291855104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318336.034618:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318336.034622:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318336.034624:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318336.034628:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3236 00000100:00080000:2.0:1767318336.034631:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318336.034635:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318336.034644:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318336.034674:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291855232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318336.035583:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291855104:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318336.035710:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318336.037435:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318336.037458:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291855360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318336.044228:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291855360:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318336.045468:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318336.045489:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318336.045495:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318336.288998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318336.357312:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318337.313178:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318337.377350:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318338.337396:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318338.401193:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318339.361060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318339.435941:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318340.386229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318340.451154:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318341.153035:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318341.153047:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318341.153050:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318341.153055:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318341.153060:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318341.153072:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3240 00000100:00080000:0.0:1767318341.153084:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318341.153092:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318341.153105:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318341.153143:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291855488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318341.153236:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291855616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318341.153536:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318341.161737:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291855616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318341.170785:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318341.170806:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318341.170812:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318341.409231:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318341.475390:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318342.433015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318342.497453:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318343.457064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318343.528215:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318344.481268:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318344.545270:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318345.504952:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318345.569582:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318346.273028:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318346.273059:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318346.273062:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318346.273066:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318346.273071:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318346.273082:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3246 00000100:00080000:0.0:1767318346.273094:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318346.273102:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318346.273114:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318346.273146:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291855744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318346.273196:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318346.273215:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291855872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318346.273449:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318346.281639:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291855872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318346.283403:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318346.283425:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318346.283431:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291855744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318346.529140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318346.593176:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318347.553257:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318347.617477:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318348.577010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318348.641125:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318349.601014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318349.665217:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318350.625069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318350.689693:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318351.393575:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318351.393588:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318351.393591:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318351.393597:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318351.393602:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318351.393621:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3251 00000100:00080000:1.0:1767318351.393638:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318351.393648:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318351.393665:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318351.393719:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291856000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318351.393819:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318351.393839:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291856128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318351.394164:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856000:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318351.440127:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318351.440144:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318351.440149:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318351.441230:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291856128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318351.649073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318351.713138:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318352.675239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318352.738906:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318353.697756:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318353.761323:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318354.723177:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318354.785134:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318355.747921:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318355.811131:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318356.513090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318356.513101:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318356.513104:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318356.513109:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318356.513113:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318356.513126:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3256 00000100:00080000:3.0:1767318356.513140:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318356.513148:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318356.513160:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318356.513197:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291856256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318356.513293:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318356.513307:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291856384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318356.515686:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318356.521859:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291856384:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318356.522015:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318356.522025:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318356.522030:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318356.769023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318356.833209:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318357.793003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318357.858624:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318358.817412:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318358.881655:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318359.841157:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318359.905772:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318360.865003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318360.929330:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318361.633063:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318361.633072:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318361.633074:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318361.633077:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318361.633080:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318361.633088:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3261 00000100:00080000:3.0:1767318361.633097:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318361.633102:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318361.633112:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318361.633141:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291856512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318361.633227:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291856640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318361.633298:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318336/real 1767318336] req@ffff8c3c5a289f80 x1853164291855104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318361 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318361.633322:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289f80 x1853164291855104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318361 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318361.633353:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856512:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318361.633391:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318361.633408:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318361.633411:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291855104:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318361.633435:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318361.633440:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318361.633443:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318361.633448:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3240 00000100:00080000:2.0:1767318361.633453:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318361.633457:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318361.633473:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291856768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318361.633535:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291856768:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318361.636252:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291856640:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318361.636349:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318361.636356:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318361.636360:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318361.890450:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318361.954901:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318362.913022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318362.979223:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318363.937225:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318364.001475:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318364.963178:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318365.025203:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318365.985116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318366.049650:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318366.753008:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318366.753041:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318366.753044:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318366.753048:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318366.753052:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318366.753063:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3266 00000100:00080000:2.0:1767318366.753074:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318366.753082:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318366.753094:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318366.753126:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291856896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318366.753202:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318366.753220:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291857024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318366.753703:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318366.761431:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291857024:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318366.761507:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318366.761514:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318366.761518:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291856896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318367.009051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318367.073966:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318368.033027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318368.097851:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318369.059017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318369.121207:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318370.080993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318370.145148:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318371.105200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318371.172542:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318371.877449:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318371.877464:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318371.877468:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318371.877472:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318371.877477:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318371.877492:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3271 00000100:00080000:3.0:1767318371.877506:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318371.877544:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318371.877559:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318371.877599:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291857152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318371.877710:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318371.877731:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291857280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318371.879014:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318371.904446:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291857280:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318371.912012:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318371.912035:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318371.912041:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318372.129226:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318372.193193:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318373.153144:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318373.217811:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318374.177326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318374.244460:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318375.201141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318375.265155:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318376.225700:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318376.289367:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318376.994060:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318376.994071:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318376.994074:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318376.994078:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318376.994082:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318376.994094:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3276 00000100:00080000:1.0:1767318376.994107:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318376.994115:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318376.994129:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318376.994174:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291857408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318376.994599:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318376.995298:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291857536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318377.005273:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291857536:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318377.006392:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318377.006405:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318377.006433:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318377.249117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318377.320759:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318378.273259:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318378.337178:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318379.297589:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318379.361340:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318380.321028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318380.385171:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318381.345505:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318381.411401:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318382.113540:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318382.113553:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318382.113555:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318382.113579:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318382.113584:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318382.113595:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3281 00000100:00080000:1.0:1767318382.113606:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318382.113614:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318382.113635:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318382.113674:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291857664/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318382.113744:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291857792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318382.114050:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857664:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318382.121827:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318382.121848:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318382.121855:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291857664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318382.126262:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291857792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318382.369078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318382.435586:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318383.393036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318383.457095:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318384.417310:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318384.483107:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318385.441218:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318385.505938:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318386.209360:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318361/real 1767318361] req@ffff8c3c5a289500 x1853164291856768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318386 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318386.209408:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289500 x1853164291856768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318386 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318386.209430:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318386.209459:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318386.209463:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291856768:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318386.209568:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318386.209578:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318386.209583:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318386.209594:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3266 00000100:00080000:0.0:1767318386.209608:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318386.209618:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318386.209679:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291857920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318386.209722:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318386.209726:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318386.209728:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318386.209733:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3287 00000100:00080000:0.0:1767318386.209737:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318386.209740:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318386.209752:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318386.209767:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291858048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318386.211036:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291858176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318386.211528:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291857920:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318386.211582:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858048:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318386.227713:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318386.227744:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318386.227750:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318386.228847:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291858176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318386.465050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318386.530422:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318387.489003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318387.555073:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318388.513022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318388.577858:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318389.537041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318389.605001:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318390.561657:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318390.627068:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318391.329175:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318391.329189:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318391.329193:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318391.329197:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318391.329203:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318391.329216:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3291 00000100:00080000:3.0:1767318391.329230:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318391.329238:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318391.329278:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318391.329318:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291858304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318391.329493:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318391.329511:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291858432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318391.329995:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318391.342461:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318391.342485:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318391.342493:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318391.342755:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291858432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318391.585272:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318391.649345:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318392.610468:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318392.673550:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318393.635859:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318393.697497:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318394.657813:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318394.722755:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318395.681833:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318395.745912:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318396.449291:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318396.449306:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318396.449318:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318396.449323:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318396.449328:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318396.449341:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3296 00000100:00080000:3.0:1767318396.449355:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318396.449364:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318396.449379:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318396.449435:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291858560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318396.449544:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318396.451291:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318396.451564:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291858688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318396.474578:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318396.474600:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318396.474606:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318396.476499:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291858688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318396.706529:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318396.769291:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318397.729491:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318397.796628:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318398.753239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318398.817246:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318399.777039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318399.841238:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318400.801092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318400.865377:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318401.569742:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318401.569750:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318401.569754:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318401.569758:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318401.569762:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318401.569773:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3301 00000100:00080000:2.0:1767318401.569784:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318401.569791:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318401.569803:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318401.569834:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291858816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318401.569931:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318401.570020:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318401.570034:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291858944:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318401.578555:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318401.578571:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318401.578576:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291858816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318401.580356:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291858944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318401.825008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318401.895654:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318402.849455:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318402.914264:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318403.873167:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318403.938657:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318404.896992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318404.961161:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318405.921095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318405.985111:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318406.689781:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318406.689792:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318406.689796:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318406.689799:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318406.689805:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318406.689815:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3306 00000100:00080000:3.0:1767318406.689827:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318406.689835:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318406.689847:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318406.689926:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291859072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318406.690024:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318406.690040:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291859200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318406.690416:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318406.695541:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291859200:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318406.696001:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318406.696010:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318406.696015:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318406.945984:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318407.009143:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318407.969039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318408.033159:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318408.993036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318409.057776:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318410.017063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318410.081943:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318411.041119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318411.105206:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318411.809090:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318386/real 1767318386] req@ffff8c3c50e9ea00 x1853164291857920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318411.809137:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ea00 x1853164291857920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318411 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318411.809160:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318411.809188:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318411.809193:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291857920:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318411.809421:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318411.809427:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318411.809431:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318411.809438:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3291 00000100:00080000:3.0:1767318411.809451:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318411.809459:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318411.809506:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291859328/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318411.809533:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318411.809537:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318411.809538:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318411.809543:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3311 00000100:00080000:3.0:1767318411.809547:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318411.809552:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318411.809576:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318411.809909:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291859328:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318411.810134:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291859456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318411.810221:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291859584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318411.810332:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318411.821400:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291859584:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318411.823724:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318411.823743:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318411.823749:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318412.066341:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318412.133077:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318413.089042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318413.153370:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318414.113066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318414.178489:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318415.138778:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318415.205046:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318416.161264:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318416.226266:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318416.934991:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318416.935005:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318416.935008:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318416.935013:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318416.935019:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318416.935033:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3316 00000100:00080000:1.0:1767318416.935046:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318416.935054:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318416.935068:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318416.935113:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291859712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318416.935216:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291859840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318416.941463:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291859840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318416.942280:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859712:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318416.947522:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318416.947544:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318416.947551:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318417.185048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318417.249358:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318418.209037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318418.275936:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318419.233020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318419.301227:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318420.257386:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318420.324648:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318421.281095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318421.346274:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318422.049009:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318422.049024:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318422.049028:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318422.049033:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318422.049039:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318422.049053:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3321 00000100:00080000:1.0:1767318422.049067:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318422.049078:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318422.049094:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318422.049147:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291859968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318422.049249:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291860096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318422.049457:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318422.055461:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291860096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318422.055647:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318422.055655:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318422.055659:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291859968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318422.305014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318422.369310:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318423.329049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318423.393303:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318424.353023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318424.417656:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318425.377365:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318425.441172:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318426.401051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318426.468279:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318427.170261:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318427.170278:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318427.170282:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318427.170286:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318427.170304:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318427.170326:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3326 00000100:00080000:2.0:1767318427.170344:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318427.170352:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318427.170369:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318427.170422:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291860224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318427.170501:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318427.170517:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291860352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318427.170905:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318427.189965:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291860352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318427.196608:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318427.196627:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318427.196634:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318427.427236:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318427.489394:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318428.449375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318428.513223:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318429.473975:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318429.537933:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318430.497235:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318430.561163:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318431.522082:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318431.586096:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318432.289434:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318432.289448:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318432.289451:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318432.289456:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318432.289462:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318432.289476:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3332 00000100:00080000:1.0:1767318432.289491:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318432.289500:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318432.289515:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318432.289559:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291860480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318432.290176:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291860608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318432.291400:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860480:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318432.310490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318432.310512:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318432.310519:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318432.312581:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291860608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318432.545046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318432.610182:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318433.569757:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318433.633257:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318434.593887:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318434.657801:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318435.617042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318435.681527:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318436.385339:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318411/real 1767318411] req@ffff8c3c58fc0000 x1853164291859328/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318436.385388:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0000 x1853164291859328/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318436.385406:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318436.385436:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318436.385441:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291859328:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318436.385672:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318436.385678:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318436.385681:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318436.385686:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3316 00000100:00080000:1.0:1767318436.385697:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318436.385703:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767318436.385739:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291860736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318436.386858:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291860736:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318436.387129:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318436.387135:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318436.387138:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318436.387143:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3337 00000100:00080000:1.0:1767318436.387147:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318436.387153:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318436.387164:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318436.387184:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291860864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318436.387837:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318436.388356:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291860992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318436.393795:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318436.393809:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318436.393815:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291860864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318436.393912:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291860992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318436.641110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318436.705307:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318437.665058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318437.729659:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318438.690328:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318438.753718:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318439.713037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318439.781537:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318440.737026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318440.801231:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318441.505160:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318441.505186:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318441.505189:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318441.505192:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318441.505196:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318441.505205:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3341 00000100:00080000:2.0:1767318441.505217:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318441.505224:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318441.505237:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318441.505266:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291861120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318441.505430:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318441.505446:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291861248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318441.505672:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318441.543650:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291861248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318441.553057:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318441.553073:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318441.553079:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318441.761375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318441.828172:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318442.785003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318442.854194:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318443.809252:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318443.875900:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318444.833103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318444.897332:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318445.857699:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318445.921141:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318446.627213:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318446.627225:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318446.627228:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318446.627233:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318446.627237:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318446.627248:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3346 00000100:00080000:3.0:1767318446.627260:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318446.627267:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318446.627279:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318446.627314:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291861376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318446.627391:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318446.627407:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291861504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318446.627650:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861376:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318446.639211:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318446.639229:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318446.639234:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318446.639383:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291861504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318446.881007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318446.947712:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318447.905095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318447.969102:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318448.929149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318448.993613:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318449.953241:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318450.017614:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318450.976997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318451.041565:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318451.750405:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318451.750415:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318451.750418:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318451.750421:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318451.750425:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318451.750435:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3351 00000100:00080000:1.0:1767318451.750445:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318451.750452:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318451.750465:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318451.750495:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291861632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318451.750568:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291861760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318451.750753:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318451.758488:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291861760:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318451.758552:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318451.758570:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318451.758576:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318452.001055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318452.065102:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318453.025126:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318453.090019:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318454.049070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318454.115518:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318455.073410:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318455.138868:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318456.097172:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318456.162313:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318456.866921:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318456.866931:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318456.866934:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318456.866938:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318456.866942:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318456.866952:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3356 00000100:00080000:2.0:1767318456.866963:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318456.866969:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318456.866982:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318456.867015:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291861888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318456.867086:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318456.867099:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291862016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318456.867360:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318456.872009:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291862016:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318456.879521:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318456.879544:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318456.879561:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291861888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318457.121131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318457.185220:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318458.145569:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318458.214488:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318459.169025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318459.233460:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318460.193088:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318460.257739:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318461.217261:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318461.283694:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318461.985289:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318436/real 1767318436] req@ffff8c3c46ab0380 x1853164291860736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318461.985335:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0380 x1853164291860736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318461.985358:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318461.985386:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318461.985391:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291860736:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318461.986444:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318461.986455:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318461.986460:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318461.986471:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3341 00000100:00080000:3.0:1767318461.986484:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318461.986493:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318461.986545:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291862144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318461.986585:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318461.986589:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318461.986591:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318461.986595:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3361 00000100:00080000:3.0:1767318461.986598:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318461.986602:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318461.986612:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318461.986625:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291862272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318461.986686:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318461.986703:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291862400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318461.987217:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291862144:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318461.987277:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318461.994673:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291862400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318461.995130:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318461.995140:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318461.995145:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318462.241184:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318462.305197:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318463.265223:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318463.329206:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318464.289808:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318464.353351:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318465.313028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318465.379497:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318466.338889:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318466.401859:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318467.108460:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318467.108472:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318467.108475:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318467.108480:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318467.108484:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318467.108495:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3366 00000100:00080000:1.0:1767318467.108506:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318467.108529:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318467.108542:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318467.108574:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291862528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318467.108643:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318467.108660:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291862656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318467.108859:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318467.112509:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291862656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318467.115565:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318467.115580:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318467.115585:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318467.362248:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318467.428002:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318468.385285:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318468.449089:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318469.410449:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318469.473157:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318470.433043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318470.497403:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318471.458988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318471.521484:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318472.227175:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318472.227185:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318472.227188:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318472.227192:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318472.227196:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318472.227206:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3372 00000100:00080000:1.0:1767318472.227230:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318472.227238:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318472.227251:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318472.227298:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291862784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318472.227371:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291862912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318472.227673:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862784:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318472.240915:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318472.240931:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318472.240937:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291862784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318472.246596:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291862912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318472.481245:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318472.551339:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318473.505485:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318473.572003:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318474.529139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318474.593263:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318475.553072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318475.617982:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318476.577248:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318476.643060:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318477.345433:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318477.345446:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318477.345450:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318477.345454:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318477.345460:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318477.345473:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3377 00000100:00080000:2.0:1767318477.345486:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318477.345494:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318477.345510:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318477.345574:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291863040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318477.345662:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318477.345677:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291863168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318477.345999:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863040:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318477.359268:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318477.359291:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318477.359297:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318477.360742:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291863168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318477.601309:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318477.665186:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318478.626049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318478.692777:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318479.649903:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318479.713471:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318480.673867:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318480.740086:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318481.697607:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318481.761195:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318482.465036:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318482.465051:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318482.465054:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318482.465059:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318482.465066:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318482.465079:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3382 00000100:00080000:3.0:1767318482.465093:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318482.465102:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318482.465118:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318482.465178:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291863296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318482.465268:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318482.465292:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291863424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318482.466527:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318482.472176:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291863424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318482.472250:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318482.472262:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318482.472267:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318482.721047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318482.792755:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318483.745125:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318483.811147:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318484.769034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318484.834249:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318485.793039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318485.858351:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318486.561069:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318461/real 1767318461] req@ffff8c3c58fc3100 x1853164291862144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318486 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318486.561114:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3100 x1853164291862144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318486 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318486.561139:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318486.561173:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318486.561178:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291862144:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318486.561353:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318486.561360:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318486.561364:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318486.561370:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3366 00000100:00080000:3.0:1767318486.561383:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318486.561391:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318486.561435:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291863552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318486.561488:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318486.561492:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318486.561494:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318486.561499:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3387 00000100:00080000:3.0:1767318486.561503:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318486.561507:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318486.561518:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318486.561531:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291863680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318486.561648:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318486.561667:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291863808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318486.561731:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291863552:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318486.569986:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318486.573330:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291863808:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318486.573490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318486.573498:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318486.573503:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318486.817476:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318486.881792:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318487.841065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318487.905412:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318488.865048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318488.929086:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318489.889236:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318489.954677:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318490.912999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318490.977190:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318491.681045:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318491.681075:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318491.681078:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318491.681082:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318491.681086:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318491.681097:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3391 00000100:00080000:2.0:1767318491.681108:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318491.681116:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318491.681128:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318491.681167:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291863936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318491.681259:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291864064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318491.681401:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318491.685511:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291864064:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318491.685612:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318491.685619:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318491.685623:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291863936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318491.940779:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318492.006554:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318492.961041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318493.025589:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318493.985161:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318494.049165:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318495.011340:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318495.073926:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318496.033080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318496.098546:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318496.802405:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318496.802418:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318496.802421:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318496.802425:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318496.802430:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318496.802442:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3396 00000100:00080000:0.0:1767318496.802457:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318496.802467:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318496.802490:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318496.802535:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291864192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318496.802636:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291864320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318496.803735:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864192:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318496.820675:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318496.820695:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318496.820701:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318496.824802:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291864320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318497.057042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318497.121644:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318498.081074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318498.146712:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318499.105033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318499.189895:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318500.128992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318500.197121:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318501.154335:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318501.217283:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318501.923477:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318501.923488:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318501.923491:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318501.923502:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318501.923507:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318501.923518:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3401 00000100:00080000:0.0:1767318501.923532:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318501.923541:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318501.923556:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318501.923592:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291864448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318501.923669:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318501.923691:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291864576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318501.924816:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318501.942954:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291864576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318501.943027:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318501.943036:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318501.943041:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318502.177049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318502.241119:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318503.201020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318503.268436:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318504.225050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318504.291817:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318505.249018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318505.313099:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318506.274264:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318506.339021:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318507.046037:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318507.046047:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318507.046050:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318507.046072:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318507.046077:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318507.046086:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3406 00000100:00080000:2.0:1767318507.046095:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318507.046102:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318507.046114:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318507.046143:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291864704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318507.046212:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291864832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318507.046592:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864704:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318507.055957:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318507.055973:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318507.055979:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291864704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318507.056818:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291864832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318507.298996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318507.362114:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318508.321029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318508.385584:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318509.345068:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318509.414230:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318510.369320:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318510.434768:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318511.138455:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318486/real 1767318486] req@ffff8c3c58fc1880 x1853164291863552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318511 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318511.138497:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1880 x1853164291863552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318511 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318511.138517:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318511.138558:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318511.138563:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291863552:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318511.138693:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318511.138698:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318511.138702:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318511.138707:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3391 00000100:00080000:1.0:1767318511.138723:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318511.138729:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767318511.138757:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291864960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318511.138780:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318511.138783:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318511.138785:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318511.138788:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3411 00000100:00080000:1.0:1767318511.138792:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318511.138795:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318511.138804:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318511.138815:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291865088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318511.138855:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318511.138867:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291865216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318511.139229:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291864960:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318511.139266:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318511.152682:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291865216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318511.152919:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318511.152927:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318511.152931:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318511.397616:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318511.457124:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318512.418494:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318512.481260:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318513.442622:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318513.505114:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318514.467077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318514.530254:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318515.489664:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318515.553441:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318516.257232:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318516.257240:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318516.257243:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318516.257246:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318516.257250:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318516.257260:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3416 00000100:00080000:2.0:1767318516.257285:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318516.257293:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318516.257314:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318516.257343:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291865344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318516.257681:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318516.257695:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291865472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318516.257929:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318516.264993:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318516.265009:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318516.265014:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318516.268866:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291865472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318516.513042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318516.577129:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318517.537344:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318517.601297:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318518.562313:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318518.628078:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318519.585069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318519.649212:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318520.610752:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318520.673166:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318521.376996:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318521.377005:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318521.377008:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318521.377012:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318521.377016:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318521.377027:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3421 00000100:00080000:2.0:1767318521.377038:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318521.377044:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318521.377055:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318521.377087:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291865600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318521.377222:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291865728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318521.380422:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318521.387435:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318521.387461:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318521.387467:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318521.393362:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291865728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318521.633004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318521.698355:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318522.656992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318522.721231:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318523.682112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318523.747210:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318524.706948:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318524.771599:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318525.728985:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318525.793911:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318526.497425:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318526.497454:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318526.497457:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318526.497461:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318526.497465:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318526.497476:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3426 00000100:00080000:1.0:1767318526.497487:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318526.497494:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318526.497506:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318526.497537:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291865856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318526.497737:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318526.498409:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291865984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318526.518326:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318526.518342:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318526.518348:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291865856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318526.519054:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291865984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318526.753028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318526.824439:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318527.777032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318527.841486:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318528.801037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318528.866343:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318529.825012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318529.889079:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318530.851811:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318530.913385:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318531.617313:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318531.617329:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318531.617333:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318531.617349:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318531.617356:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318531.617368:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3431 00000100:00080000:3.0:1767318531.617384:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318531.617393:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318531.617408:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318531.617455:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291866112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318531.617544:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318531.617561:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291866240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318531.618025:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866112:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318531.623657:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318531.623679:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318531.623686:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318531.623849:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291866240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318531.875558:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318531.937216:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318532.897139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318532.963009:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318533.923820:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318533.985231:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318534.946954:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318535.011341:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318535.969233:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318536.034648:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318536.737711:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1767318536.738141:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318511/real 1767318511] req@ffff8c3c46ab2a00 x1853164291864960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318536.738182:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2a00 x1853164291864960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318536.738354:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318536.738358:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318536.738363:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318536.738369:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318536.738406:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3436 00000100:00080000:3.0:1767318536.738421:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318536.738431:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318536.738447:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318536.738493:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291866368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318536.738774:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291866496:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318536.744721:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318536.744769:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318536.744778:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291864960:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318536.744821:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318536.745002:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318536.745010:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318536.745013:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318536.745020:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3416 00000100:00080000:3.0:1767318536.745026:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318536.745148:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318536.745193:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291866624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318536.745254:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291866624:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318536.752058:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318536.752081:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318536.752087:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318536.753433:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291866496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318536.993473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318537.057169:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318538.017095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318538.081252:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318539.041091:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318539.112264:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318540.072409:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318540.129543:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318541.089224:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318541.153381:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318541.857015:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318541.857041:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318541.857045:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318541.857049:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318541.857054:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318541.857076:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3441 00000100:00080000:1.0:1767318541.857113:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318541.857122:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318541.857137:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318541.857177:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291866752/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318541.857423:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291866880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318541.857580:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318541.862104:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291866880:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318541.864153:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318541.864172:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318541.864177:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291866752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318542.114249:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318542.177298:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318543.137032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318543.202484:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318544.161033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318544.227306:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318545.185368:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318545.249222:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318546.209201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318546.273201:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318546.980048:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318546.980063:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318546.980066:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318546.980084:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318546.980090:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318546.980103:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3446 00000100:00080000:3.0:1767318546.980117:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318546.980126:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318546.980139:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318546.980202:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291867008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318546.987466:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318546.990765:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291867136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318546.995540:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318546.995559:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318546.995565:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318547.005297:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291867136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318547.238526:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318547.302013:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318548.257022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318548.321926:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318549.281061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318549.345235:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318550.305510:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318550.375076:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318551.330924:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318551.394206:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318552.098937:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318552.098947:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318552.098951:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318552.098955:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318552.098960:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318552.098998:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3451 00000100:00080000:1.0:1767318552.099011:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318552.099019:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318552.099034:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318552.099070:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291867264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318552.099659:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318552.099790:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291867392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318552.105143:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318552.105160:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318552.105165:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318552.105457:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291867392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318552.353386:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318552.417121:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318553.377034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318553.441524:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318554.400984:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318554.465532:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318555.425727:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318555.491252:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318556.449175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318556.514184:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318557.218421:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318557.218432:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318557.218435:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318557.218439:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318557.218444:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318557.218454:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3456 00000100:00080000:1.0:1767318557.218465:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318557.218472:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318557.218484:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318557.218518:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291867520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318557.218598:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318557.223466:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318557.223498:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291867648:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318557.247090:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318557.247106:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318557.247111:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318557.247210:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291867648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318557.473100:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318557.541226:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318558.497457:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318558.562320:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318559.521170:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318559.587439:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318560.546318:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318560.609309:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318561.313047:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318536/real 1767318536] req@ffff8c3c58fc0700 x1853164291866624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318561.313090:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0700 x1853164291866624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318561.313115:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318561.313150:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318561.313155:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291866624:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318561.313271:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318561.313278:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318561.313305:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318561.313311:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3441 00000100:00080000:2.0:1767318561.313322:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318561.313330:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318561.313368:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291867776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318561.313398:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318561.313402:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318561.313404:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318561.313408:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3462 00000100:00080000:2.0:1767318561.313411:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318561.313416:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318561.313426:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318561.313440:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291867904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318561.313635:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291867776:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318561.313749:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318561.316958:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291868032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318561.320935:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291868032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318561.321305:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318561.321313:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318561.321318:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291867904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318561.570610:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318561.633323:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318562.593370:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318562.658241:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318563.617063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318563.681866:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318564.641088:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318564.706261:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318565.665029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318565.731304:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318566.433745:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318566.433757:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318566.433760:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318566.433764:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318566.433769:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318566.433782:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3466 00000100:00080000:2.0:1767318566.433815:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318566.433830:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318566.433853:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318566.433915:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291868160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318566.434025:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318566.435756:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291868288:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318566.447153:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318566.447173:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318566.447180:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318566.447520:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291868288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318566.689667:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318566.753160:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318567.712971:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318567.784084:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318568.736988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318568.801490:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318569.760999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318569.825299:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318570.786735:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318570.854273:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318571.553686:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318571.553700:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318571.553703:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318571.553707:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318571.553712:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318571.553725:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3471 00000100:00080000:2.0:1767318571.553738:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318571.553748:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318571.553762:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318571.553821:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291868416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318571.553958:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318571.554971:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291868544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318571.564078:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318571.564101:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318571.564108:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318571.567331:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291868544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318571.809640:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318571.873204:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318572.834396:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318572.897727:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318573.857423:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318573.922582:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318574.881631:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318574.945425:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318575.905511:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318575.969567:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318576.673826:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318576.673837:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318576.673841:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318576.673864:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318576.673868:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318576.673898:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3476 00000100:00080000:2.0:1767318576.673909:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318576.673916:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318576.673928:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318576.673960:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291868672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318576.674144:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291868800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318576.674327:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868672:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318576.678917:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318576.678932:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318576.678938:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318576.679078:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291868800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318576.929051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318576.994615:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318577.953495:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318578.017607:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318578.978906:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318579.042331:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318580.001021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318580.065527:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318581.025117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318581.089846:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318581.793125:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318581.793138:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318581.793141:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318581.793145:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318581.793150:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318581.793164:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3481 00000100:00080000:1.0:1767318581.793179:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318581.793188:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318581.793203:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318581.793251:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291868928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318581.793339:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318581.795238:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318581.806651:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318581.807095:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318581.807103:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318581.807108:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291868928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318582.050626:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318582.115170:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318583.075277:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318583.139685:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318584.097189:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318584.161790:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318585.121107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318585.185439:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318586.145254:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318586.211237:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318586.913115:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318561/real 1767318561] req@ffff8c3c5a289500 x1853164291867776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318586 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318586.913161:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289500 x1853164291867776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318586 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318586.913186:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318586.913219:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318586.913226:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291867776:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318586.913437:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318586.913444:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318586.913448:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318586.913454:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3466 00000100:00080000:2.0:1767318586.913466:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318586.913473:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318586.913514:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291869184/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318586.913563:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318586.913567:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318586.913569:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318586.913574:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3486 00000100:00080000:2.0:1767318586.913578:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318586.913582:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318586.913592:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318586.913606:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291869312/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318586.914002:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291869184:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318586.914132:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318586.914299:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291869440:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318586.925385:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318586.925406:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318586.925412:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318586.925646:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291869440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318587.169221:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318587.234680:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318588.193015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318588.257864:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318589.217226:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318589.281092:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318590.241606:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318590.305182:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318591.267778:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318591.329482:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318592.035248:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318592.035261:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318592.035265:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318592.035296:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318592.035302:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318592.035314:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3491 00000100:00080000:1.0:1767318592.035328:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318592.035337:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318592.035354:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318592.035397:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291869568/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318592.035504:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318592.035525:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318592.035957:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869568:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318592.046158:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318592.046180:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318592.046186:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318592.046332:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318592.293097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318592.354561:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318593.313021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318593.379714:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318594.337473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318594.402688:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318595.361074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318595.425145:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318596.385436:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318596.450357:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318597.154126:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318597.154139:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318597.154143:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318597.154148:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318597.154164:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318597.154178:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3496 00000100:00080000:1.0:1767318597.154191:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318597.154212:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318597.154235:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318597.154305:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291869824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318597.154643:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318597.155835:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318597.159658:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291869952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318597.160200:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318597.160209:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318597.160234:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291869824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318597.408974:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318597.474215:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318598.433407:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318598.497414:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318599.457340:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318599.521174:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318600.480997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318600.546470:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318601.505019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318601.569158:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318602.273453:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318602.273463:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318602.273467:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318602.273471:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318602.273477:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318602.273491:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3502 00000100:00080000:1.0:1767318602.273506:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318602.273515:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318602.273538:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318602.273579:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291870080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318602.273744:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318602.274204:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291870208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318602.277116:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318602.277136:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318602.277143:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318602.277854:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291870208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318602.529039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318602.593270:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318603.554184:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318603.617178:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318604.577375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318604.642618:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318605.601022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318605.665750:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318606.628232:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318606.691066:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318607.395830:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318607.395840:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318607.395843:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318607.395847:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318607.395853:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318607.395865:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3507 00000100:00080000:2.0:1767318607.395894:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318607.395903:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318607.395923:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318607.395959:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291870336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318607.396101:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318607.399682:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291870464:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318607.402046:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318607.402059:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318607.402064:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318607.404728:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291870464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318607.649484:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318607.714105:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318608.673008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318608.737437:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318609.697009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318609.761133:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318610.725588:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318610.786833:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318611.489547:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318586/real 1767318586] req@ffff8c3c5a289f80 x1853164291869184/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318611 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318611.489588:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289f80 x1853164291869184/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318611 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318611.489609:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318611.489701:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318611.489707:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291869184:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318611.490590:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318611.490598:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318611.490619:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318611.490626:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3491 00000100:00080000:0.0:1767318611.490636:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318611.490642:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318611.490671:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291870592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318611.490700:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318611.490703:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318611.490705:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318611.490709:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3512 00000100:00080000:0.0:1767318611.490713:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318611.490716:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318611.490726:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318611.490737:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291870720/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318611.490801:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318611.490815:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291870848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318611.491581:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291870592:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318611.491628:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870720:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318611.498055:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318611.498070:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318611.498076:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318611.498752:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291870848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318611.744993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318611.810713:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318612.770275:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318612.833636:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318613.793001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318613.857082:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318614.817202:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318614.882512:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318615.842915:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318615.905165:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318616.609905:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318616.609913:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318616.609917:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318616.609922:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318616.609926:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318616.609936:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3516 00000100:00080000:2.0:1767318616.609946:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318616.609953:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318616.609964:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318616.609993:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291870976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318616.610063:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318616.610481:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318616.630023:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871104:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318616.630282:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318616.630289:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318616.630293:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291870976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318616.865040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318616.929524:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318617.891193:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318617.953706:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318618.913021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318618.977545:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318619.937045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318620.002488:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318620.961767:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318621.026506:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318621.729062:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318621.729072:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318621.729076:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318621.729080:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318621.729084:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318621.729095:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3521 00000100:00080000:2.0:1767318621.729104:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318621.729110:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318621.729119:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318621.729151:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291871232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318621.729209:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318621.729223:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318621.730009:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318621.737136:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871360:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318621.737417:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318621.737425:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318621.737430:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318621.985420:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318622.051817:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318623.009023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318623.077894:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318624.033381:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318624.097418:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318625.057055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318625.121265:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318626.082437:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318626.146412:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318626.860938:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318626.860953:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318626.860956:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318626.860961:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318626.860966:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318626.860979:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3526 00000100:00080000:3.0:1767318626.860994:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318626.861028:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318626.861044:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318626.861081:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291871488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318626.862841:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318626.863427:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318626.876274:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291871616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318626.885920:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318626.885936:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318626.885942:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318627.105038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318627.169108:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318628.129645:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318628.193111:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318629.153018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318629.217788:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318630.177009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318630.241234:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318631.201231:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318631.265099:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318631.968987:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318631.968997:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318631.969001:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318631.969005:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318631.969009:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318631.969020:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3531 00000100:00080000:3.0:1767318631.969032:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318631.969040:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318631.969054:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318631.969090:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291871744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318631.969188:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318631.969559:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291871872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318631.982191:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318631.982213:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318631.982220:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291871744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318631.982547:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291871872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318632.226853:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318632.289424:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318633.249165:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318633.318148:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318634.273079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318634.337385:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318635.297273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318635.361125:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318636.067303:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318611/real 1767318611] req@ffff8c3c50e9fb80 x1853164291870592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318636 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318636.067340:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9fb80 x1853164291870592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318636 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318636.067380:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318636.067414:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318636.067418:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291870592:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318636.067484:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318636.067495:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318636.067500:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318636.067511:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3516 00000100:00080000:3.0:1767318636.067524:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318636.067549:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318636.067592:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291872000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318636.067641:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318636.067645:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318636.067647:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318636.067651:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3536 00000100:00080000:3.0:1767318636.067655:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318636.067659:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318636.067671:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318636.067683:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291872128/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318636.067747:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318636.067767:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291872256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318636.068052:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291872000:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318636.068110:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318636.076268:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291872256:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318636.078680:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318636.078692:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318636.078697:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318636.321108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318636.385407:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318637.344995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318637.409234:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318638.370957:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318638.433326:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318639.393014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318639.457077:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318640.416988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318640.481279:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318641.185035:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318641.185045:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318641.185048:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318641.185051:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318641.185057:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318641.185067:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3540 00000100:00080000:3.0:1767318641.185077:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318641.185084:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318641.185116:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318641.185145:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291872384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318641.185319:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318641.185342:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291872512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318641.185346:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872384:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318641.189553:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318641.189567:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318641.189572:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318641.189664:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291872512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318641.441001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318641.505110:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318642.465457:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318642.530097:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318643.491222:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318643.556284:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318644.514252:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318644.578644:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318645.537090:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318645.601185:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318646.306437:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318646.306447:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318646.306450:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318646.306454:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318646.306458:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318646.306469:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3546 00000100:00080000:2.0:1767318646.306479:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318646.306486:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318646.306498:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318646.306532:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291872640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318646.306627:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318646.306642:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291872768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318646.306914:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318646.326661:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291872768:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318646.330928:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318646.330946:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318646.330967:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318646.561089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318646.626700:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318647.585246:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318647.649105:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318648.609369:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318648.673235:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318649.634651:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318649.698473:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318650.657004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318650.721287:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318651.425384:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318651.425394:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318651.425398:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318651.425401:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318651.425405:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318651.425415:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3551 00000100:00080000:2.0:1767318651.425426:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318651.425433:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318651.425446:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318651.425482:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291872896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318651.425593:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318651.425595:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318651.425604:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318651.444268:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873024:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318651.445676:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318651.445689:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318651.445694:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291872896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318651.681024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318651.745229:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318652.705525:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318652.769282:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318653.729456:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318653.798020:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318654.753073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318654.817783:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318655.777106:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318655.841186:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318656.545182:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318656.545198:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318656.545200:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318656.545205:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318656.545211:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318656.545224:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3556 00000100:00080000:3.0:1767318656.545239:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318656.545250:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318656.545266:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318656.545315:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291873152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318656.545488:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318656.545907:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873152:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318656.564361:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318656.564467:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318656.564475:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318656.565138:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318656.801763:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318656.865193:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318657.825045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318657.894438:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318658.849099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318658.913212:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318659.873064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318659.937345:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318660.897025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318660.961256:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318661.665595:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318636/real 1767318636] req@ffff8c3c58fc0e00 x1853164291872000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318661.665639:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0e00 x1853164291872000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318661.665677:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318661.665689:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318661.665694:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291872000:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318661.666045:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318661.666051:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318661.666056:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318661.666062:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3540 00000100:00080000:0.0:1767318661.666074:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318661.666082:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318661.666134:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291873408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318661.666189:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318661.666193:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318661.666195:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318661.666199:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3561 00000100:00080000:0.0:1767318661.666204:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318661.666209:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318661.666220:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318661.666233:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291873536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318661.666340:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291873664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318661.666389:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291873408:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318661.669487:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873536:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318661.689501:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318661.689522:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318661.689529:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318661.695227:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291873664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318661.923465:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318661.988609:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318662.945804:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318663.010398:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318663.969066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318664.034046:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318664.993323:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318665.057194:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318666.017067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318666.081472:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318666.785755:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318666.785762:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318666.785765:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318666.785769:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318666.785773:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318666.785784:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3566 00000100:00080000:2.0:1767318666.785794:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318666.785801:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318666.785820:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318666.785849:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291873792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318666.785964:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318666.785994:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318666.786357:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318666.792121:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291873920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318666.792590:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318666.792609:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318666.792614:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291873792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318667.041541:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318667.106250:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318668.065116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318668.130581:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318669.089428:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318669.153134:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318670.113078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318670.177466:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318671.137045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318671.209091:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318671.905039:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318671.905047:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318671.905050:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318671.905053:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318671.905057:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318671.905066:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3571 00000100:00080000:2.0:1767318671.905075:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318671.905081:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318671.905091:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318671.905127:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291874048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318671.905346:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318671.905567:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291874176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318671.918111:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291874176:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318671.918192:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318671.918211:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318671.918214:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318672.162364:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318672.225316:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318673.185642:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318673.249080:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318674.209096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318674.273520:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318675.234434:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318675.297130:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318676.257174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318676.323222:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318677.025129:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318677.025138:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318677.025141:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318677.025145:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318677.025149:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318677.025159:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3576 00000100:00080000:0.0:1767318677.025172:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318677.025179:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318677.025192:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318677.025224:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291874304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318677.025314:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291874432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318677.025449:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318677.032319:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318677.032343:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318677.032349:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318677.040223:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291874432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318677.291282:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318677.346944:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318678.305036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318678.370113:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318679.329365:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318679.395940:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318680.353082:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318680.417361:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318681.377011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318681.444221:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318682.148995:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318682.149006:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318682.149009:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318682.149012:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318682.149016:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318682.149027:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3581 00000100:00080000:2.0:1767318682.149038:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318682.149046:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318682.149060:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318682.149092:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291874560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318682.149499:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318682.149515:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291874688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318682.149658:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318682.159791:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291874688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318682.160502:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318682.160519:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318682.160524:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318682.401022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318682.465182:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318683.427624:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318683.493644:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318684.449406:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318684.513153:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318685.473290:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318685.537380:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318686.241018:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318661/real 1767318661] req@ffff8c3c50e9fb80 x1853164291873408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318686 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318686.241052:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9fb80 x1853164291873408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318686 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318686.241072:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318686.241168:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318686.241173:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291873408:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318686.241241:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318686.241246:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318686.241249:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318686.241254:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3566 00000100:00080000:3.0:1767318686.241263:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318686.241268:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318686.241297:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291874816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318686.241348:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291874816:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318686.241985:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318686.241990:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318686.241993:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318686.241999:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3587 00000100:00080000:3.0:1767318686.242004:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318686.242009:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318686.242019:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318686.242048:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291874944/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318686.242103:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318686.246230:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291875072:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318686.252072:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318686.252087:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318686.252107:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291874944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318686.255628:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291875072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318686.518521:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318686.561147:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318687.521144:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318687.585662:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318688.545085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318688.610027:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318689.569014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318689.633125:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318690.592997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318690.657303:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318691.361057:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318691.361071:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318691.361075:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318691.361079:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318691.361084:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318691.361096:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3591 00000100:00080000:3.0:1767318691.361111:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318691.361120:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318691.361135:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318691.361192:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291875200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318691.361313:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318691.364786:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318691.365214:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875200:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318691.373973:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318691.373996:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318691.374002:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318691.617061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318691.690823:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318692.641030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318692.707234:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318693.666568:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318693.729260:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318694.689034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318694.753151:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318695.714859:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318695.778612:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318696.481503:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318696.481519:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318696.481522:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318696.481527:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318696.481532:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318696.481547:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3596 00000100:00080000:2.0:1767318696.481561:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318696.481571:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318696.482999:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318696.483057:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291875456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318696.483169:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318696.483190:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318696.487319:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318696.489994:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875584:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318696.497195:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318696.497216:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318696.497222:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318696.737136:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318696.802027:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318697.763834:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318697.825074:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318698.785034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318698.850060:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318699.811855:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318699.873408:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318700.837523:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318700.897143:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318701.604117:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318701.604131:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318701.604134:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318701.604139:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318701.604145:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318701.604158:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3601 00000100:00080000:2.0:1767318701.604173:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318701.604182:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318701.604197:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318701.604239:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291875712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318701.604455:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318701.605949:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318701.617001:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291875840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318701.621258:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318701.621274:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318701.621279:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318701.857034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318701.922398:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318702.881309:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318702.945242:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318703.905700:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318703.970896:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318704.929005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318704.993500:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318705.953150:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318706.018363:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318706.721114:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318706.721126:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318706.721129:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318706.721133:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318706.721138:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318706.721149:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3606 00000100:00080000:1.0:1767318706.721162:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318706.721170:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318706.721183:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318706.721217:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291875968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318706.721294:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318706.721307:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291876096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318706.721727:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318706.725775:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291876096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318706.725947:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318706.725954:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318706.725977:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291875968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318706.977026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318707.042562:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318708.001058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318708.065965:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318709.025015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318709.092823:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318710.048993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318710.114460:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318711.073001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318711.138906:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318711.841052:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318686/real 1767318686] req@ffff8c3c58fc2a00 x1853164291874816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318711 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318711.841089:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2a00 x1853164291874816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318711 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318711.841108:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318711.841143:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318711.841147:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291874816:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318711.841251:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318711.841256:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318711.841259:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318711.841265:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3591 00000100:00080000:0.0:1767318711.841275:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318711.841281:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318711.841314:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291876224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318711.841342:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318711.841345:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318711.841347:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318711.841351:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3611 00000100:00080000:0.0:1767318711.841354:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318711.841372:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318711.841381:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318711.841392:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291876352/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318711.841442:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318711.841453:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318711.841618:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291876224:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318711.841654:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318711.850480:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876480:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318711.854658:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318711.854674:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318711.854680:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318712.097145:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318712.161320:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318713.122040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318713.185385:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318714.145380:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318714.212297:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318715.169300:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318715.239564:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318716.193085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318716.257807:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318716.961227:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318716.961242:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318716.961246:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318716.961250:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318716.961257:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318716.961269:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3616 00000100:00080000:0.0:1767318716.961282:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318716.961291:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318716.961306:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318716.961344:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291876608/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318716.961444:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318716.962168:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318716.971648:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876736:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318716.979392:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318716.979411:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318716.979417:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318717.217323:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318717.281510:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318718.241051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318718.305867:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318719.265039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318719.331597:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318720.289069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318720.354013:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318721.313012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318721.377092:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318722.081315:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318722.081331:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318722.081334:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318722.081339:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318722.081345:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318722.081357:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3621 00000100:00080000:0.0:1767318722.081371:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318722.081379:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318722.081393:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318722.081597:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291876864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318722.081674:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318722.081902:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318722.081915:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318722.098483:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318722.098505:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318722.098513:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291876864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318722.107484:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291876992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318722.337142:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318722.401958:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318723.361263:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318723.425261:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318724.385044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318724.455239:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318725.413586:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318725.473259:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318726.433039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318726.497343:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318727.201034:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318727.201048:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318727.201050:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318727.201056:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318727.201062:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318727.201075:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3626 00000100:00080000:0.0:1767318727.201089:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318727.201097:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318727.201112:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318727.201156:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291877120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318727.201338:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291877248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318727.201901:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877120:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318727.207806:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318727.207821:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318727.207827:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318727.208869:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291877248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318727.456997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318727.522627:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318728.481006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318728.545110:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318729.504995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318729.571136:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318730.529537:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318730.594532:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318731.553598:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318731.619144:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318732.321158:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318732.321170:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318732.321174:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318732.321177:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318732.321181:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318732.321192:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3632 00000100:00080000:3.0:1767318732.321203:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318732.321210:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318732.321222:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318732.321258:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291877376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318732.321329:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291877504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318732.321602:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877376:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318732.333522:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318732.333538:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318732.333543:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318732.333663:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291877504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318732.577035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318732.642410:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318733.601052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318733.665266:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318734.625004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318734.689099:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318735.649000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318735.713189:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318736.417016:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318711/real 1767318711] req@ffff8c3c50e9f800 x1853164291876224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318736 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318736.417073:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f800 x1853164291876224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318736 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318736.417092:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318736.417117:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318736.417122:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291876224:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318736.417272:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318736.417278:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318736.417281:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318736.417287:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3616 00000100:00080000:3.0:1767318736.417296:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318736.417335:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318736.417370:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291877632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318736.417396:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318736.417400:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318736.417402:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318736.417405:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3637 00000100:00080000:3.0:1767318736.417409:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318736.417413:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318736.417423:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318736.417435:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291877632:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318736.417435:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291877760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318736.417527:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291877888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318736.417528:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877760:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318736.419679:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318736.419694:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318736.419701:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291877760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318736.419732:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291877888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318736.673002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318736.740655:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318737.697328:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318737.761800:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318738.721159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318738.794430:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318739.745010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318739.809330:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318740.772963:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318740.833587:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318741.537463:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318741.537478:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318741.537481:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318741.537485:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318741.537491:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318741.537503:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3641 00000100:00080000:0.0:1767318741.537517:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318741.537549:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318741.537577:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318741.537619:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291878016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318741.538166:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291878144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318741.538265:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318741.545406:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291878144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318741.545526:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318741.545535:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318741.545540:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318741.793339:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318741.857461:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318742.818437:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318742.881381:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318743.841046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318743.906017:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318744.865686:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318744.936305:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318745.889065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318745.953393:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318746.657477:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318746.657505:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318746.657509:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318746.657513:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318746.657518:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318746.657531:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3646 00000100:00080000:0.0:1767318746.657545:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318746.657555:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318746.657570:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318746.657614:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291878272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318746.657728:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291878400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318746.662623:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318746.663638:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291878400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318746.666590:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318746.666611:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318746.666617:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318746.916382:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318746.977168:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318747.940488:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318748.001238:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318748.963591:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318749.025171:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318749.985140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318750.054792:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318751.009402:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318751.073162:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318751.777655:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318751.777670:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318751.777674:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318751.777678:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318751.777683:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318751.777696:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3651 00000100:00080000:0.0:1767318751.777710:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767318751.777719:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318751.777735:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318751.777781:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291878528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318751.777988:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291878656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318751.778385:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318751.781528:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291878656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767318751.796397:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318751.796419:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318751.796425:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318752.033830:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318752.100278:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318753.057055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318753.121429:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318754.081502:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318754.145406:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318755.105008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318755.176277:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318756.139187:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318756.194960:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318756.897323:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318756.897338:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318756.897342:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318756.897346:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318756.897352:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318756.897390:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3656 00000100:00080000:0.0:1767318756.897406:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1767318756.897415:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318756.897429:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318756.897472:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291878784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318756.897659:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291878912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318756.899729:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878784:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318756.907727:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318756.907747:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318756.907767:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291878784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318756.908048:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291878912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318757.153307:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318757.217067:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318757.921306:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291879040:192.168.202.133@tcp:17:kworker.0 00000100:00100000:2.0:1767318757.925241:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291879040:192.168.202.133@tcp:17:kworker.0 00000100:00100000:2.0:1767318758.177330:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318758.241410:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318759.201314:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318759.265430:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318760.225458:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318760.289208:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318761.248988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318761.313164:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318762.017143:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318762.017158:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318762.017162:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318762.017167:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318762.017173:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1767318762.017199:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318736/real 1767318736] req@ffff8c3c58fc1c00 x1853164291877632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318762.017204:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3661 00000100:00080000:3.0:1767318762.017220:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1767318762.017228:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318762.017238:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1c00 x1853164291877632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1767318762.017243:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:2.0:1767318762.017259:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318762.017281:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318762.017286:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291877632:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318762.017535:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291879168/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318762.017607:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879168:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318762.017823:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318762.017827:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318762.017830:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318762.017835:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3641 00000100:00080000:3.0:1767318762.017840:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318762.017844:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318762.017855:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291879424/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318762.018088:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291879424:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767318762.018501:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291879296:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318762.020944:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318762.020962:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318762.020968:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318762.023365:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291879296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318762.273301:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318762.338002:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318763.297106:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318763.361225:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318764.321103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318764.385075:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318765.347566:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318765.410368:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318766.369451:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318766.433299:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318767.137172:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318767.137183:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318767.137187:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318767.137192:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318767.137198:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318767.137212:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3666 00000100:00080000:3.0:1767318767.137227:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318767.137235:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318767.137250:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318767.137314:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291879552/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318767.137434:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291879680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318767.140594:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879552:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318767.144285:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318767.144312:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318767.144319:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318767.145867:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291879680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318767.398512:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318767.457788:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318768.417770:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318768.484478:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318769.441024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318769.505208:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318770.465190:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318770.529979:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318771.489054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318771.553564:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318772.256997:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318772.257008:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318772.257011:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318772.257015:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318772.257020:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318772.257030:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3672 00000100:00080000:3.0:1767318772.257040:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318772.257047:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318772.257058:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318772.257091:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291879808/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318772.257192:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291879936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318772.259194:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318772.261308:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291879936:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318772.264257:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318772.264274:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318772.264281:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291879808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318772.518420:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318772.577116:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318773.538308:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318773.601056:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318774.560994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318774.625194:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318775.585017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318775.650388:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318776.609129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318776.673092:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318777.378542:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318777.378557:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318777.378560:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318777.378565:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318777.378592:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318777.378604:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3677 00000100:00080000:0.0:1767318777.378808:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318777.378818:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318777.379017:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318777.379138:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291880064/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318777.379227:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318777.379785:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291880192:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318777.389189:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318777.389211:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318777.389217:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318777.405458:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291880192:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318777.633064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318777.697367:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318778.659131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318778.721337:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318779.681153:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318779.745451:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318780.705295:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318780.769140:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318781.729497:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318781.793305:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318782.497139:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318782.497154:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318782.497157:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318782.497186:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318782.497192:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318782.497206:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3682 00000100:00080000:2.0:1767318782.497220:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318782.497228:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318782.497244:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318782.497287:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291880320/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318782.497929:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291880448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318782.499070:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318782.508988:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291880448:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318782.509170:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318782.509178:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318782.509182:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318782.753131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318782.820810:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318783.777059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318783.841312:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318784.801037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318784.865796:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318785.825047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318785.890537:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318786.849034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318786.913679:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318787.617164:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318762/real 1767318762] req@ffff8c3c58fc2d80 x1853164291879424/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318787.617211:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2d80 x1853164291879424/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318787.617235:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318787.617246:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318787.617252:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291879424:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318787.617357:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318787.617364:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318787.617368:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318787.617374:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3666 00000100:00080000:3.0:1767318787.617399:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318787.617407:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318787.617475:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291880576/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318787.617504:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318787.617508:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318787.617511:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318787.617515:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3687 00000100:00080000:3.0:1767318787.617519:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318787.617523:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318787.617535:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318787.617556:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291880704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318787.617890:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291880832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318787.618054:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291880576:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318787.618089:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880704:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318787.622404:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318787.622425:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318787.622431:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318787.623084:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291880832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318787.873029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318787.938985:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318788.897155:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318788.961695:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318789.921000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318789.988975:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318790.946064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318791.012211:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318791.969114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318792.033227:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318792.737479:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318792.737521:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318792.737524:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318792.737528:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318792.737533:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318792.737547:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3692 00000100:00080000:2.0:1767318792.737562:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318792.737571:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318792.737586:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318792.737629:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291880960/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318792.737727:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318792.737749:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291881088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318792.738020:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880960:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318792.742108:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318792.742128:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318792.742134:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291880960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318792.742388:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291881088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318792.993038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318793.059528:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318794.018464:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318794.081323:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318795.041040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318795.105091:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318796.065012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318796.131634:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318797.090439:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318797.156480:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318797.857111:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318797.857123:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318797.857126:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318797.857130:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318797.857135:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318797.857146:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3697 00000100:00080000:0.0:1767318797.857158:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318797.857166:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318797.857179:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318797.857218:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291881216/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318797.857319:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291881344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318797.858093:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318797.864464:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291881344:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318797.865389:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318797.865398:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318797.865403:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318798.113002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318798.177327:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318799.137324:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318799.201167:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318800.161552:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318800.232176:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318801.185964:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318801.249177:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318802.209292:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318802.279764:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318802.978182:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318802.978189:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318802.978193:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318802.978197:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318802.978201:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318802.978211:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3702 00000100:00080000:3.0:1767318802.978223:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318802.978230:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318802.978244:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318802.978272:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291881472/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318802.978361:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318802.978376:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291881600:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318802.978607:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881472:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318802.982716:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318802.982729:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318802.982734:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881472:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318802.986339:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291881600:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318803.233276:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318803.307340:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318804.257159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318804.321220:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318805.281002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318805.345283:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318806.308323:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318806.369400:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318807.329448:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318807.393447:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318808.097023:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318808.097034:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318808.097037:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318808.097041:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318808.097045:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318808.097057:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3707 00000100:00080000:3.0:1767318808.097070:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318808.097122:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318808.097134:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318808.097307:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291881728/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318808.097423:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318808.097577:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291881856:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318808.105276:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318808.105290:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318808.105294:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291881728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318808.105436:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291881856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318808.355994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318808.417563:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318809.377028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318809.441073:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318810.401002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318810.465295:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318811.425184:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318811.489146:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318812.193033:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318787/real 1767318787] req@ffff8c3c58fc1880 x1853164291880576/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318812.193068:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1880 x1853164291880576/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318812.193088:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318812.193116:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318812.193121:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291880576:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318812.193259:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318812.193264:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318812.193268:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318812.193280:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3692 00000100:00080000:2.0:1767318812.193290:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318812.193297:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318812.193331:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291881984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318812.193363:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318812.193367:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318812.193369:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318812.193387:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3712 00000100:00080000:2.0:1767318812.193391:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318812.193395:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318812.193404:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318812.193416:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291882112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318812.193569:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291881984:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767318812.193645:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318812.193713:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318812.193719:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291882240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318812.203169:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767318812.205207:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291882240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318812.208058:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318812.208072:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318812.449476:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318812.513209:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318813.474112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318813.541975:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318814.498866:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318814.562985:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318815.521032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318815.585094:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318816.545001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318816.609155:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318817.316554:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318817.316564:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318817.316596:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318817.316601:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318817.316616:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318817.316627:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3717 00000100:00080000:3.0:1767318817.316639:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318817.316647:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318817.316731:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318817.316763:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291882368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318817.316892:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318817.316913:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291882496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318817.317530:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318817.321748:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318817.321763:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318817.321768:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318817.321929:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291882496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318817.569264:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318817.633103:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318818.596152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318818.658953:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318819.617063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318819.684066:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318820.641083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318820.710081:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318821.664982:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318821.729475:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318822.432977:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318822.432987:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318822.432989:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318822.432993:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318822.432998:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318822.433008:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3722 00000100:00080000:3.0:1767318822.433018:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318822.433025:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318822.433036:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318822.433070:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291882624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318822.433250:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318822.433845:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318822.433857:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291882752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318822.439756:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291882752:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318822.442024:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318822.442039:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318822.442045:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318822.690815:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318822.755747:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318823.713008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318823.777212:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318824.736992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318824.803724:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318825.762613:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318825.825173:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318826.785674:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318826.850938:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318827.553185:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318827.553195:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318827.553198:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318827.553202:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318827.553206:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318827.553215:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3727 00000100:00080000:1.0:1767318827.553225:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318827.553232:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318827.553244:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318827.553277:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164291882880/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318827.553342:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291883008:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318827.553775:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318827.557325:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291883008:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318827.561273:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318827.561289:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318827.561294:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291882880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318827.809166:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318827.878310:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318828.834601:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318828.899256:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318829.857086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318829.921223:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318830.881077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318830.949816:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318831.905034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318831.969206:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318832.673314:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318832.673325:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318832.673328:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318832.673332:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318832.673336:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318832.673347:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3732 00000100:00080000:2.0:1767318832.673358:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318832.673366:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318832.673378:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318832.673423:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291883136/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318832.673505:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318832.673519:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291883264:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318832.673794:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318832.684271:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291883264:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318832.690848:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318832.690866:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318832.690895:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318832.929229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318832.994339:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318833.954124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318834.017276:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318834.977237:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318835.041232:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318836.001304:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318836.065321:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318837.025148:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318837.089232:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318837.793055:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318837.793066:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318837.793069:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318837.793072:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318837.793077:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318837.793087:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3737 00000100:00080000:2.0:1767318837.793097:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318837.793104:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318837.793115:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318837.793150:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291883392/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318837.793508:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318812/real 1767318812] req@ffff8c3c5a28b800 x1853164291881984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318837.793536:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b800 x1853164291881984/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318837.793555:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883392:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318837.793650:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318837.793729:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318837.793733:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291881984:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318837.794837:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318837.794916:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291883520:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318837.797982:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318837.797993:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318837.797997:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318837.798007:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3717 00000100:00080000:0.0:1767318837.798018:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318837.798025:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318837.798060:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291883648/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318837.798218:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291883648:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767318837.800674:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318837.800692:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318837.800698:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318837.800979:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291883520:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318838.051523:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318838.113416:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318839.073019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318839.137564:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318840.099369:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318840.161271:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318841.121265:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318841.185756:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318842.144994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318842.210550:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318842.913247:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318842.913276:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318842.913279:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318842.913283:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318842.913288:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318842.913298:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3742 00000100:00080000:3.0:1767318842.913418:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318842.913427:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318842.913518:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318842.913551:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291883776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318842.913732:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291883904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318842.913900:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318842.926108:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291883904:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318842.926144:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318842.926154:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318842.926159:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291883776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318843.169182:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318843.233476:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318844.193154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318844.257949:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318845.216980:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318845.282649:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318846.241004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318846.305237:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318847.270210:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318847.331006:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318848.032981:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318848.032992:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318848.032995:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318848.032999:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318848.033003:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318848.033013:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3747 00000100:00080000:3.0:1767318848.033024:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318848.033031:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318848.033043:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318848.033078:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291884032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318848.033169:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318848.033183:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291884160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318848.033194:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884032:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318848.043926:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318848.043947:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318848.043965:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318848.044144:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291884160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318848.289038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318848.354430:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318849.313094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318849.377759:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318850.336987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318850.402933:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318851.361754:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318851.425404:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318852.386403:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318852.449319:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318853.153152:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318853.153189:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318853.153193:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318853.153197:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318853.153202:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318853.153216:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3752 00000100:00080000:0.0:1767318853.153229:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318853.153238:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318853.153267:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318853.153316:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291884288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318853.153404:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291884416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318853.153833:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884288:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318853.161317:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318853.161339:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318853.161345:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318853.163954:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291884416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318853.409402:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318853.473932:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318854.433072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318854.498525:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318855.457060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318855.527275:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318856.481044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318856.545239:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318857.504966:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318857.569847:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318858.273456:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318858.273471:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318858.273474:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318858.273478:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318858.273486:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318858.273500:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3758 00000100:00080000:2.0:1767318858.273514:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318858.273523:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318858.273540:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318858.273599:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291884544/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318858.273667:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318858.273865:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318858.273900:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291884672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318858.280237:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291884672:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318858.284102:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318858.284124:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318858.284131:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318858.529053:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318858.593403:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318859.553385:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318859.617303:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318860.577026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318860.641194:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318861.601028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318861.670140:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318862.369306:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318837/real 1767318837] req@ffff8c3c50e9e680 x1853164291883648/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318862 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318862.369351:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9e680 x1853164291883648/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318862 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318862.369375:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318862.369406:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318862.369410:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291883648:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318862.369538:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318862.369546:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318862.369550:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318862.369556:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3742 00000100:00080000:0.0:1767318862.369568:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318862.369577:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318862.369620:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291884800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318862.369679:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318862.369683:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318862.369685:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318862.369689:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3763 00000100:00080000:0.0:1767318862.369694:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318862.369698:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318862.369708:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318862.369721:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291884928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318862.369782:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291885056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318862.370007:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291884800:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318862.370123:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884928:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318862.378593:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318862.378616:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318862.378622:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291884928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318862.387335:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291885056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318862.625200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318862.689384:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318863.648956:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318863.713244:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318864.673118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318864.737663:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318865.698732:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318865.763636:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318866.721030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318866.790106:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318867.490250:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318867.490258:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318867.490261:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318867.490266:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318867.490271:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318867.490282:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3767 00000100:00080000:2.0:1767318867.490295:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318867.490303:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318867.490317:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318867.490361:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291885184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318867.490431:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318867.490447:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318867.490671:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318867.500105:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318867.500286:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318867.500295:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318867.500299:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318867.745062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318867.813059:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318868.771672:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318868.833672:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318869.793073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318869.857237:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318870.817211:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318870.883120:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318871.841015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318871.908369:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318872.609091:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318872.609107:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318872.609111:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318872.609116:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318872.609123:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318872.609136:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3772 00000100:00080000:2.0:1767318872.609150:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318872.609158:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318872.609174:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318872.609230:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291885440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318872.609548:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318872.611432:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318872.621033:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885568:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318872.630858:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318872.630913:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318872.630919:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318872.865271:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318872.931004:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318873.888968:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318873.955407:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318874.913078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318874.977560:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318875.937255:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318876.001400:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318876.961074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318877.025475:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318877.731379:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318877.731394:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318877.731397:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318877.731605:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318877.731611:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318877.731624:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3777 00000100:00080000:3.0:1767318877.731638:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318877.731647:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318877.731664:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318877.731707:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291885696/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318877.731786:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318877.731807:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318877.732055:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885696:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318877.740010:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318877.740041:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318877.740048:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318877.740093:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291885824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318877.986406:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318878.049116:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318879.012923:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318879.074844:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318880.034199:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318880.100216:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318881.059425:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318881.123431:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318882.081086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318882.145225:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318882.849211:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318882.849246:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318882.849249:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318882.849254:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318882.849259:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318882.849272:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3782 00000100:00080000:0.0:1767318882.849285:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318882.849293:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318882.849306:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318882.849361:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291885952/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318882.849430:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318882.849446:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291886080:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318882.849460:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318882.858455:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291886080:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318882.860234:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318882.860254:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318882.860262:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291885952:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318883.105979:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318883.170958:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318884.129066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318884.194024:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318885.153102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318885.217121:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318886.177083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318886.241407:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318887.201069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318887.269171:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318887.969128:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318887.969140:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318887.969144:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318887.969149:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318887.969154:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318887.969167:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3787 00000100:00080000:0.0:1767318887.969181:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318887.969213:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318887.969227:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318887.969267:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291886208/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318887.969469:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291886336:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318887.974000:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318862/real 1767318862] req@ffff8c3c50e9c380 x1853164291884800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318887 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318887.974043:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c380 x1853164291884800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318887 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318887.974072:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886208:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767318887.974223:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318887.974251:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767318887.974257:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291884800:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318887.974614:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318887.974621:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318887.974625:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318887.974631:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3767 00000100:00080000:0.0:1767318887.974638:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318887.974645:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318887.974679:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291886464/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318887.976097:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291886336:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318887.978581:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291886464:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318887.978804:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318887.978812:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767318887.978817:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886208:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318888.227620:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318888.289623:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318889.250297:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318889.313312:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318890.273096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318890.340577:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318891.297086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318891.361250:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318892.321095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318892.385861:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318893.089202:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318893.089215:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318893.089218:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318893.089222:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318893.089229:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318893.089242:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3792 00000100:00080000:3.0:1767318893.089269:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318893.089278:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318893.089293:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318893.089340:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291886592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318893.089461:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291886720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318893.090267:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886592:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318893.094224:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318893.094250:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318893.094258:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318893.095145:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291886720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318893.346670:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318893.411825:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318894.369050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318894.433363:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318895.394155:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318895.459707:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318896.417004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318896.481313:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318897.441031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318897.505347:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318898.209006:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318898.209019:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318898.209022:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318898.209026:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318898.209031:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318898.209043:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3797 00000100:00080000:3.0:1767318898.209054:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318898.209062:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318898.209286:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318898.209322:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291886848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318898.209392:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291886976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318898.209786:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318898.213377:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291886976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318898.213712:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318898.213718:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318898.213721:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291886848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318898.465016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318898.529288:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318899.489107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318899.553247:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318900.513012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318900.581012:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318901.537266:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318901.601116:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318902.561297:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318902.625159:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318903.329189:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318903.329196:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318903.329212:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318903.329216:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318903.329219:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318903.329228:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3803 00000100:00080000:1.0:1767318903.329238:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318903.329245:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318903.329256:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318903.329285:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291887104/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318903.329352:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291887232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318903.329804:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887104:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318903.333356:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318903.333369:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318903.333375:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318903.333408:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291887232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318903.585169:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318903.649571:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318904.609039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318904.673268:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318905.633198:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318905.697204:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318906.662044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318906.724238:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318907.681330:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318907.746190:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318908.450999:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318908.451009:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318908.451012:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318908.451016:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318908.451020:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318908.451030:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3808 00000100:00080000:3.0:1767318908.451041:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318908.451067:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318908.451078:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318908.451109:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291887360/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318908.451219:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887360:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318908.451649:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291887488:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318908.457359:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318908.457373:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318908.457378:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887360:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318908.457849:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291887488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318908.705001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318908.769043:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318909.728999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318909.794416:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318910.753989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318910.817695:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318911.777017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318911.841333:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318912.545015:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318887/real 1767318887] req@ffff8c3c50e9ea00 x1853164291886464/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318912.545051:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ea00 x1853164291886464/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318912.545070:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318912.545099:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318912.545104:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291886464:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767318912.545321:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318912.545327:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318912.545331:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318912.545336:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3792 00000100:00080000:3.0:1767318912.545345:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318912.545351:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767318912.545384:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291887616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318912.545409:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318912.545413:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318912.545414:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318912.545418:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3813 00000100:00080000:3.0:1767318912.545422:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318912.545426:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318912.545434:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318912.545447:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291887744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318912.545502:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318912.545515:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291887872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318912.546747:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291887616:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318912.546818:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887744:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318912.562309:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318912.562331:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318912.562337:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291887744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318912.566141:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291887872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318912.801754:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318912.866084:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318913.825051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318913.889261:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318914.849078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318914.915719:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318915.873097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318915.939011:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318916.897127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318916.961186:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318917.665252:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318917.665260:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318917.665277:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318917.665281:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318917.665284:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318917.665294:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3817 00000100:00080000:2.0:1767318917.665306:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318917.665313:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318917.665324:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318917.665355:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291888000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318917.665444:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318917.665502:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318917.676030:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888128:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318917.676114:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318917.676122:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318917.676128:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318917.921035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318917.985180:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318918.945111:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318919.009246:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318919.969093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318920.033174:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318920.993005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318921.057133:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318922.016993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318922.081670:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318922.784976:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318922.784986:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318922.784989:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318922.784993:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318922.784998:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318922.785007:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3822 00000100:00080000:2.0:1767318922.785018:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318922.785025:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318922.785053:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318922.785084:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291888256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318922.785154:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318922.785573:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318922.785583:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888384:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318922.797271:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318922.797287:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318922.797292:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318922.797487:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318923.041009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318923.105073:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318924.068731:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318924.129143:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318925.092426:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318925.153191:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318926.113011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318926.177158:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318927.137014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318927.201518:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318927.907624:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318927.907636:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318927.907639:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318927.907643:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318927.907647:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318927.907658:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3827 00000100:00080000:1.0:1767318927.907669:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318927.907676:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318927.907689:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318927.907735:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291888512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318927.907831:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291888640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318927.909533:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888512:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318927.922032:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318927.922059:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318927.922065:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318927.924786:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291888640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318928.161432:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318928.227009:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318929.185200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318929.249263:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318930.210853:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318930.273167:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318931.235012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318931.297103:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318932.257182:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318932.321188:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318933.025216:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318933.025228:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318933.025231:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318933.025235:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318933.025240:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318933.025250:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3832 00000100:00080000:2.0:1767318933.025262:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318933.025270:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318933.025282:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318933.025320:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291888768/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318933.025399:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888896:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318933.027545:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318933.028213:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291888896:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318933.033379:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318933.033396:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318933.033402:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291888768:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318933.281097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318933.346444:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318934.305672:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318934.371131:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318935.329416:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318935.393360:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318936.353032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318936.417054:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318937.121633:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318912/real 1767318912] req@ffff8c3c58fc1f80 x1853164291887616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318937 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318937.121677:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1f80 x1853164291887616/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318937.121700:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318937.121730:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767318937.121736:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291887616:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767318937.121895:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318937.121902:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318937.121907:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318937.121913:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3817 00000100:00080000:0.0:1767318937.121925:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318937.121934:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318937.121978:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291889024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318937.122006:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318937.122010:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318937.122012:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318937.122016:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3837 00000100:00080000:0.0:1767318937.122019:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318937.122024:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318937.122035:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318937.122047:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291889152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318937.122113:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318937.122129:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291889280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318937.123051:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291889024:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767318937.123132:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889152:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318937.125519:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318937.125536:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318937.125557:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767318937.125728:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291889280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318937.376982:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318937.441169:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318938.401642:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318938.465243:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318939.425816:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318939.489863:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318940.449228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318940.513596:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318941.473013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318941.537179:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318942.241417:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318942.241438:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318942.241441:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318942.241445:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318942.241450:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318942.241460:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3842 00000100:00080000:3.0:1767318942.241471:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318942.241478:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318942.241490:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318942.241526:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291889408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318942.241609:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318942.242122:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291889536:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318942.256698:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318942.256717:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318942.256722:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318942.256795:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291889536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318942.497097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318942.562940:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318943.521010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318943.585313:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318944.544998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318944.609193:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318945.569307:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318945.633041:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318946.593011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318946.657106:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318947.362458:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318947.362468:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318947.362471:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318947.362475:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318947.362480:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318947.362491:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3847 00000100:00080000:2.0:1767318947.362502:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318947.362510:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318947.362522:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318947.362560:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291889664/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318947.362643:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291889792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318947.362840:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318947.370832:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291889792:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318947.371665:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318947.371675:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318947.371679:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318947.617060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318947.681078:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318948.640981:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318948.705130:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318949.665030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318949.729322:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318950.688997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318950.758272:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318951.714045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318951.777388:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318952.480995:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318952.481005:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318952.481008:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318952.481012:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318952.481016:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318952.481026:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3852 00000100:00080000:2.0:1767318952.481037:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318952.481044:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318952.481055:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318952.481104:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291889920/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318952.481154:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318952.481248:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291890048:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318952.488844:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767318952.488851:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291890048:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318952.488853:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318952.488857:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291889920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318952.738987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318952.801303:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318953.761415:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318953.825140:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318954.785947:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318954.849060:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318955.809421:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318955.873357:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318956.833025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318956.899314:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318957.600986:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318957.600998:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318957.601001:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318957.601005:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318957.601010:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318957.601020:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3857 00000100:00080000:3.0:1767318957.601031:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318957.601040:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318957.601051:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318957.601085:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291890176/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318957.601160:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890176:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318957.601338:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291890304:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767318957.608149:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318957.608165:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318957.608170:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890176:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318957.609551:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291890304:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318957.857005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318957.923395:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318958.880996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318958.945132:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318959.905004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318959.969321:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318960.930886:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318960.994141:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318961.953939:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318962.020694:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318962.721158:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318937/real 1767318937] req@ffff8c3c50e9c700 x1853164291889024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318962 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318962.721204:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c700 x1853164291889024/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318962 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318962.721229:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318962.726357:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318962.726373:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318962.726379:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318962.726393:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3842 00000100:00080000:0.0:1767318962.726413:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318962.726422:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767318962.726475:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291890432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318962.726498:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318962.726501:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318962.726503:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318962.726507:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3862 00000100:00080000:0.0:1767318962.726510:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318962.726514:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318962.726524:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318962.726534:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291890560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318962.726684:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291890688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318962.728062:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767318962.728075:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291889024:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318962.728113:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291890432:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318962.728218:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318962.739927:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291890688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767318962.742190:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318962.742209:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318962.742216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318962.980517:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318963.043307:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318964.002043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318964.065117:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318965.025734:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318965.089230:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318966.049024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318966.113831:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318967.075625:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318967.137946:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318967.841474:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318967.841486:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318967.841489:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318967.841494:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318967.841518:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318967.841531:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3867 00000100:00080000:0.0:1767318967.841545:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318967.841553:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318967.841569:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318967.841608:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291890816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318967.841942:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291890944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318967.842643:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890816:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767318967.850982:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318967.850999:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767318967.851005:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291890816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318967.855041:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291890944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318968.097143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318968.161334:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318969.121139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318969.185143:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318970.145237:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318970.209698:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318971.170551:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318971.233213:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318972.193022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318972.257206:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318972.962381:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318972.962392:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318972.962412:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318972.962416:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318972.962420:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318972.962431:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3872 00000100:00080000:3.0:1767318972.962442:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318972.962449:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318972.962462:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318972.962494:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291891072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318972.962681:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291891200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767318972.964776:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891072:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767318972.991516:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318972.991532:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767318972.991537:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318972.995354:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291891200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318973.217307:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318973.281034:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318974.240982:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318974.307900:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318975.265009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318975.329075:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318976.289009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318976.353104:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318977.313745:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318977.379913:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318978.081130:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318978.081141:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318978.081144:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318978.081148:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318978.081153:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318978.081163:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3877 00000100:00080000:0.0:1767318978.081185:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318978.081193:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767318978.081206:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318978.081239:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291891328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318978.081403:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291891456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767318978.081540:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891328:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318978.094779:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318978.094796:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318978.094802:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318978.095622:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291891456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318978.337319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318978.401162:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318979.366420:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318979.425193:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318980.385019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318980.450131:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318981.409152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318981.474445:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318982.433142:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318982.497035:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318983.202270:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318983.202279:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318983.202282:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318983.202286:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318983.202290:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318983.202321:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3882 00000100:00080000:2.0:1767318983.202332:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318983.202339:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318983.202350:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318983.202378:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291891584/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318983.202449:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318983.202463:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291891712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318983.202466:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891584:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318983.212169:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318983.212188:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318983.212194:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318983.212446:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291891712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318983.458228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318983.521574:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318984.481003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318984.545369:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318985.505012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318985.569148:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318986.530914:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318986.593170:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318987.299369:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318962/real 1767318962] req@ffff8c3c50e9dc00 x1853164291890432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318987 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318987.299403:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9dc00 x1853164291890432/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318987 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318987.299422:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318987.299451:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767318987.299457:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291890432:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767318987.299493:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318987.299499:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318987.299502:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318987.299508:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3867 00000100:00080000:2.0:1767318987.299516:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318987.299523:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767318987.299555:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291891840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318987.299584:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318987.299588:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318987.299590:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318987.299609:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3888 00000100:00080000:2.0:1767318987.299613:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318987.299617:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767318987.299626:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318987.299639:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291891968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318987.299742:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291891840:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767318987.299785:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291892096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318987.300114:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891968:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318987.302716:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318987.302729:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318987.302735:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291891968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318987.302867:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291892096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318987.553813:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318987.617116:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318988.577207:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318988.641270:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318989.601163:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318989.666139:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318990.625006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318990.689198:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318991.649011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767318991.713052:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318992.418179:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318992.418190:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318992.418193:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318992.418197:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318992.418201:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318992.418210:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3892 00000100:00080000:1.0:1767318992.418220:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318992.418227:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767318992.418240:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318992.418272:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291892224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318992.418346:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291892352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318992.419422:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892224:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767318992.423773:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318992.423789:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318992.423794:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767318992.424247:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291892352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767318992.674435:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767318992.737981:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318993.697447:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318993.761680:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318994.721218:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318994.787038:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318995.754785:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318995.809122:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318996.769176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318996.837093:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318997.538416:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318997.538433:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318997.538437:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318997.538441:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318997.538447:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318997.538460:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3897 00000100:00080000:3.0:1767318997.538476:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318997.538511:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767318997.538526:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318997.538567:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291892480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318997.538671:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318997.538689:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291892608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767318997.540198:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767318997.541555:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291892608:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767318997.557825:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318997.557847:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767318997.557854:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767318997.794369:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767318997.860692:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318998.823632:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318998.881516:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318999.841403:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767318999.906759:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319000.865152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319000.928995:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319001.889542:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319001.953227:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319002.657749:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319002.657766:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319002.657769:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319002.657774:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319002.657781:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319002.657795:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3902 00000100:00080000:0.0:1767319002.657812:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319002.657820:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319002.657837:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319002.657920:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291892736/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319002.657999:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291892864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319002.658195:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892736:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319002.664320:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319002.664342:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319002.664348:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319002.664563:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291892864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319002.913046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319002.977137:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319003.937444:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319004.001395:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319004.961051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319005.026168:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319005.985637:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319006.050967:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319007.009055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319007.076022:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319007.777476:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319007.777499:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319007.777503:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319007.777508:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319007.777514:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319007.777528:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3907 00000100:00080000:3.0:1767319007.777542:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319007.777551:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319007.777566:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319007.777613:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291892992/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319007.777704:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892992:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319007.778015:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291893120:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319007.784134:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291893120:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319007.784296:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319007.784304:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319007.784309:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291892992:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319008.035020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319008.097770:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319009.057532:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319009.121187:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319010.082598:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319010.145078:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319011.105311:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319011.169171:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319012.129507:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319012.193136:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319012.897439:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319012.897454:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1767319012.897456:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318987/real 1767318987] req@ffff8c3c5a28b800 x1853164291891840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319012 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319012.897457:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319012.897461:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319012.897466:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319012.897481:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3912 00000100:00080000:0.0:1767319012.897493:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319012.897502:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319012.897504:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b800 x1853164291891840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319012 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1767319012.897522:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:3.0:1767319012.897531:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319012.897554:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319012.897559:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291891840:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319012.897566:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291893248/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319012.897589:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893248:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319012.897621:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319012.897624:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319012.897626:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319012.897630:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3892 00000100:00080000:0.0:1767319012.897633:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319012.897637:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319012.897648:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291893504/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319012.897673:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291893376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319012.903250:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291893504:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319012.919996:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319012.920019:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319012.920025:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893248:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319012.921149:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291893376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319013.153337:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319013.220372:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319014.177484:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319014.241383:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319015.202292:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319015.265168:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319016.225050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319016.290115:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319017.249310:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319017.313814:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319018.021177:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319018.021200:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319018.021203:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319018.021208:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319018.021213:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319018.021228:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3917 00000100:00080000:1.0:1767319018.021250:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319018.021260:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319018.021275:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319018.021321:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291893632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319018.021408:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291893760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319018.021410:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893632:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319018.031630:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319018.031647:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319018.031654:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319018.035552:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291893760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319018.273039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319018.337801:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319019.297036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319019.361631:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319020.321058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319020.385196:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319021.345203:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319021.409348:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319022.369028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319022.436661:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319023.137395:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319023.137408:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319023.137412:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319023.137417:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319023.137422:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319023.137435:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3922 00000100:00080000:1.0:1767319023.137448:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319023.137457:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319023.137470:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319023.137527:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291893888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319023.137619:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319023.137636:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291894016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319023.138021:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893888:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319023.146044:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319023.146061:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319023.146066:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291893888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319023.146841:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291894016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319023.393344:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319023.458136:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319024.419965:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319024.481120:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319025.441004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319025.505227:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319026.465095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319026.529124:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319027.489030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319027.553378:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319028.257104:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319028.257115:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319028.257117:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319028.257122:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319028.257126:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319028.257138:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3928 00000100:00080000:3.0:1767319028.257148:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319028.257156:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319028.257167:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319028.257203:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291894144/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319028.257264:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319028.257282:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894272:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319028.257495:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319028.266374:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894272:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319028.266920:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319028.266929:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319028.266933:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319028.513001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319028.577255:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319029.537086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319029.602941:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319030.563617:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319030.637723:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319031.584986:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319031.649153:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319032.609067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319032.673045:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319033.377174:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319033.377197:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319033.377206:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319033.377211:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319033.377224:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319033.377237:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3933 00000100:00080000:2.0:1767319033.377253:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319033.377262:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319033.377277:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319033.377322:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291894400/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319033.377411:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894528:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319033.377757:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894400:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319033.381566:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319033.381587:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319033.381604:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894400:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319033.381657:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894528:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319033.633047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319033.705553:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319034.657685:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319034.722171:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319035.681070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319035.745183:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319036.705042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319036.769167:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319037.473167:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319012/real 1767319012] req@ffff8c3c50e9f100 x1853164291893504/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319037.473215:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f100 x1853164291893504/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319037.473252:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319037.473277:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319037.473283:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291893504:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319037.473461:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319037.473467:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319037.473470:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319037.473477:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3917 00000100:00080000:2.0:1767319037.473487:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319037.473495:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319037.473539:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291894656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319037.473661:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291894656:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319037.474049:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319037.474054:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319037.474057:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319037.474062:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3938 00000100:00080000:2.0:1767319037.474067:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319037.474072:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319037.474085:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319037.474103:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291894784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319037.477983:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319037.479058:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319037.479077:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894912:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319037.482126:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319037.482147:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319037.482153:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291894784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319037.482260:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291894912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319037.729124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319037.795101:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319038.753911:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319038.818701:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319039.776993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319039.841278:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319040.800985:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319040.865834:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319041.824999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319041.892429:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319042.593628:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319042.593638:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319042.593642:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319042.593646:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319042.593650:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319042.593660:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3942 00000100:00080000:0.0:1767319042.593671:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319042.593677:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319042.593688:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319042.593725:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291895040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319042.593793:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319042.593815:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291895168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319042.593995:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319042.600713:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291895168:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319042.600818:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319042.600824:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319042.600829:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319042.849049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319042.914717:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319043.873015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319043.939337:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319044.896996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319044.962839:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319045.921094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319045.985223:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319046.945063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319047.009260:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319047.713017:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319047.713055:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319047.713059:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319047.713062:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319047.713067:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319047.713079:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3947 00000100:00080000:0.0:1767319047.713090:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319047.713097:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319047.713110:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319047.713143:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291895296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319047.713383:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319047.713410:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291895424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319047.714429:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319047.718938:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291895424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319047.721793:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319047.721810:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319047.721816:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319047.969099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319048.033498:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319048.993001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319049.057503:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319050.017472:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319050.082119:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319051.040984:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319051.105112:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319052.065008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319052.130280:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319052.833543:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319052.833550:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319052.833553:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319052.833555:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319052.833559:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319052.833566:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3952 00000100:00080000:0.0:1767319052.833576:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319052.833581:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319052.833590:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319052.833634:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291895552/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319052.833731:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319052.835509:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291895680:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319052.836511:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319052.836528:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319052.836547:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319052.840334:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291895680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319053.090181:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319053.153163:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319054.113208:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319054.177403:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319055.138931:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319055.202610:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319056.161121:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319056.225108:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319057.185340:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319057.252581:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319057.953366:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319057.953387:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319057.953390:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319057.953394:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319057.953398:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319057.953408:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3957 00000100:00080000:2.0:1767319057.953420:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319057.953428:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319057.953440:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319057.953479:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291895808/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319057.953543:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319057.953707:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291895936:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319057.963281:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291895936:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319057.963518:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319057.963526:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319057.963530:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291895808:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319058.209051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319058.273323:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319059.233339:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319059.298006:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319060.256996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319060.321823:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319061.281014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319061.353279:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319062.051596:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319037/real 1767319037] req@ffff8c3c5a289180 x1853164291894656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319062.051630:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289180 x1853164291894656/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319062.051650:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319062.051680:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319062.051684:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291894656:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319062.051722:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319062.051727:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319062.051730:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319062.051735:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3942 00000100:00080000:2.0:1767319062.051745:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319062.051751:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319062.051782:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291896064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319062.051808:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319062.051842:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319062.051844:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319062.051848:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3962 00000100:00080000:2.0:1767319062.051852:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319062.051856:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319062.051866:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319062.051903:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291896192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319062.051949:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291896320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319062.052320:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291896064:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319062.052365:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896192:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319062.056542:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319062.056566:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319062.056571:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319062.057053:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291896320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319062.305005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319062.369235:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319063.329010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319063.393259:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319064.352969:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319064.417310:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319065.377022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319065.441059:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319066.401005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319066.465158:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319067.168979:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319067.168986:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319067.168997:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319067.169000:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319067.169004:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319067.169012:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3966 00000100:00080000:2.0:1767319067.169022:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319067.169027:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319067.169036:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319067.169064:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291896448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319067.169212:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291896576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319067.169384:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896448:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319067.175490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319067.175504:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319067.175510:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319067.175607:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291896576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319067.425158:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319067.489129:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319068.449013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319068.513199:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319069.473062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319069.537102:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319070.497010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319070.561186:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319071.520976:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319071.585743:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319072.289125:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319072.289136:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319072.289139:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319072.289143:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319072.289147:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319072.289156:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3972 00000100:00080000:2.0:1767319072.289167:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319072.289173:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319072.289194:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319072.289251:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291896704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319072.289346:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291896832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319072.289849:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319072.300147:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291896832:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319072.309642:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319072.309659:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319072.309665:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319072.546360:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319072.610278:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319073.570431:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319073.633119:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319074.593206:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319074.659122:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319075.617509:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319075.681140:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319076.643010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319076.705305:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319077.409284:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319077.409295:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319077.409298:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319077.409301:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319077.409305:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319077.409316:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3977 00000100:00080000:3.0:1767319077.409328:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319077.409336:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319077.409349:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319077.409553:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291896960/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319077.409637:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319077.409652:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291897088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319077.409804:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896960:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319077.419845:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319077.419861:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319077.419867:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291896960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319077.420354:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291897088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319077.665453:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319077.729689:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319078.690797:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319078.760305:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319079.713000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319079.777156:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319080.737010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319080.805028:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319081.761259:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319081.825429:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319082.528985:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319082.528997:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319082.529001:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319082.529005:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319082.529010:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319082.529020:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3982 00000100:00080000:3.0:1767319082.529031:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319082.529040:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319082.529052:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319082.529083:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291897216/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319082.529169:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319082.529185:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291897344:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319082.529896:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319082.533204:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291897344:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319082.537356:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319082.537371:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319082.537376:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897216:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319082.785022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319082.849245:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319083.809902:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319083.873046:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319084.833010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319084.897207:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319085.857009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319085.922826:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319086.882393:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319086.945135:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319087.649071:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319062/real 1767319062] req@ffff8c3c5a28a680 x1853164291896064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319087.649140:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28a680 x1853164291896064/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319087.649172:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319087.649194:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319087.649217:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291896064:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319087.649260:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319087.649267:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319087.649271:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319087.649284:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3966 00000100:00080000:3.0:1767319087.649293:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319087.649300:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319087.649331:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291897472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319087.649360:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319087.649364:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319087.649366:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319087.649370:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3987 00000100:00080000:3.0:1767319087.649374:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319087.649378:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319087.649387:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319087.649398:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291897600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319087.649453:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319087.649465:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291897728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319087.650082:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291897472:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319087.650152:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319087.659842:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291897728:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319087.669046:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319087.669062:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319087.669069:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319087.905006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319087.978917:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319088.931445:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319088.993060:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319089.952953:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319090.017219:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319090.982977:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319091.041131:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319092.001001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319092.065109:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319092.769007:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319092.769017:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319092.769020:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319092.769024:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319092.769028:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319092.769039:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3992 00000100:00080000:0.0:1767319092.769050:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319092.769070:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319092.769081:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319092.769116:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291897856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319092.769181:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319092.769302:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291897984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319092.776522:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291897984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319092.776674:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319092.776690:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319092.776696:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291897856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319093.025042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319093.089390:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319094.049051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319094.113758:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319095.082101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319095.137199:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319096.097272:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319096.161158:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319097.121058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319097.186433:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319097.889377:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319097.889402:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319097.889405:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319097.889409:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319097.889413:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319097.889432:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 3997 00000100:00080000:3.0:1767319097.889442:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319097.889449:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319097.889460:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319097.889489:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291898112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319097.889547:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319097.889560:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291898240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319097.890000:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319097.893963:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291898240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319097.894817:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319097.894830:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319097.894835:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319098.145036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319098.211572:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319099.171223:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319099.233375:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319100.193521:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319100.257383:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319101.219315:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319101.281250:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319102.241040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319102.308479:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319103.009205:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319103.009218:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319103.009222:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319103.009226:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319103.009231:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319103.009245:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4002 00000100:00080000:2.0:1767319103.009282:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319103.009291:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319103.009306:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319103.009349:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291898368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319103.009455:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291898496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319103.009618:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319103.015039:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319103.015062:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319103.015088:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319103.015289:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291898496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319103.265104:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319103.329262:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319104.289081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319104.353420:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319105.313204:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319105.377417:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319106.339102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319106.401276:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319107.363432:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319107.425211:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319108.129367:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319108.129383:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319108.129386:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319108.129391:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319108.129396:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319108.129410:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4007 00000100:00080000:1.0:1767319108.129426:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319108.129435:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319108.129451:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319108.129491:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291898624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319108.129572:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291898752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319108.130853:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319108.133166:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291898752:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319108.143782:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319108.143803:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319108.143808:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291898624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319108.388832:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319108.450292:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319109.410775:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319109.473200:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319110.433042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319110.498524:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319111.457002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319111.521263:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319112.225187:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319087/real 1767319087] req@ffff8c3c58fc0a80 x1853164291897472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319112.225233:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0a80 x1853164291897472/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319112.225286:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319112.225324:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319112.225329:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291897472:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319112.225390:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319112.225398:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319112.225402:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319112.225408:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 3992 00000100:00080000:3.0:1767319112.225426:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319112.225434:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319112.225474:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291898880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319112.225500:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319112.225504:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319112.225506:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319112.225510:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4013 00000100:00080000:3.0:1767319112.225514:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319112.225519:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319112.225530:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319112.225541:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291899008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319112.225610:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319112.225624:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291899136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319112.225709:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291898880:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319112.225762:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319112.239305:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291899136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319112.240676:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319112.240699:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319112.240705:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319112.481940:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319112.546868:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319113.504994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319113.570589:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319114.529501:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319114.593089:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319115.553079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319115.617233:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319116.578301:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319116.645409:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319117.344997:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319117.345008:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319117.345011:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319117.345015:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319117.345019:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319117.345029:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4017 00000100:00080000:3.0:1767319117.345056:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319117.345063:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319117.345074:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319117.345117:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291899264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319117.345203:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319117.345220:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291899392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319117.347564:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899264:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319117.350823:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319117.350852:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319117.350859:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319117.351545:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291899392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319117.601017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319117.667356:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319118.625176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319118.690401:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319119.653360:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319119.713178:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319120.673142:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319120.738639:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319121.697354:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319121.763368:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319122.464993:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319122.465003:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319122.465006:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319122.465010:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319122.465014:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319122.465024:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4022 00000100:00080000:3.0:1767319122.465034:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319122.465041:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319122.465052:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319122.465087:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291899520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319122.465159:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319122.465181:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291899648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319122.465468:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319122.473442:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291899648:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319122.473554:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319122.473560:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319122.473564:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319122.722454:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319122.786107:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319123.745341:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319123.809441:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319124.768996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319124.834928:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319125.793023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319125.858897:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319126.816976:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319126.881669:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319127.585132:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319127.585160:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319127.585173:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319127.585177:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319127.585181:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319127.585192:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4027 00000100:00080000:1.0:1767319127.585203:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319127.585211:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319127.585222:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319127.585254:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291899776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319127.585323:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319127.585340:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291899904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319127.585761:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899776:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319127.590296:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319127.590313:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291899904:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319127.590334:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319127.590343:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291899776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319127.841023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319127.906305:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319128.865037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319128.929447:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319129.889039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319129.953104:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319130.913044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319130.977567:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319131.937055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319132.002584:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319132.705003:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319132.705015:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319132.705018:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319132.705022:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319132.705026:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319132.705037:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4032 00000100:00080000:1.0:1767319132.705048:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319132.705056:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319132.705089:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319132.705139:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291900032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319132.705357:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319132.705377:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291900160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319132.705936:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319132.711144:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291900160:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319132.711322:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319132.711329:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319132.711334:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319132.961249:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319133.025167:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319133.985108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319134.049153:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319135.008995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319135.073891:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319136.033076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319136.097511:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319137.056997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319137.121264:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319137.824997:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319137.825007:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319137.825010:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319137.825013:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319137.825017:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319137.825028:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4037 00000100:00080000:1.0:1767319137.825038:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319137.825045:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319137.825057:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319137.825090:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291900288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319137.825165:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291900416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319137.825310:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319112/real 1767319112] req@ffff8c3c58fc0700 x1853164291898880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319137 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319137.825335:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0700 x1853164291898880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319137 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319137.825348:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900288:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319137.825379:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319137.825395:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319137.825400:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291898880:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319137.825455:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319137.825459:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319137.825461:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319137.825465:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4017 00000100:00080000:1.0:1767319137.825469:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319137.825472:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319137.825484:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291900544/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319137.825626:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291900544:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319137.832583:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1767319137.832585:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291900416:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319137.832598:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319137.832603:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319138.081010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319138.145625:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319139.105081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319139.171077:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319140.130564:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319140.194056:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319141.154054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319141.217219:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319142.180847:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319142.241319:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319142.945424:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319142.945434:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319142.945437:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319142.945442:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319142.945446:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319142.945456:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4042 00000100:00080000:1.0:1767319142.945467:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319142.945473:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319142.945485:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319142.945518:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291900672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319142.945628:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319142.945630:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291900800:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319142.953834:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319142.953858:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319142.953866:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319142.954092:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291900800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319143.201049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319143.265735:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319144.225174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319144.289393:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319145.250855:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319145.313985:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319146.273038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319146.337208:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319147.297000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319147.361139:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319148.072377:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319148.072388:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319148.072391:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319148.072394:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319148.072398:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319148.072407:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4047 00000100:00080000:3.0:1767319148.072432:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319148.072440:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319148.072453:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319148.072485:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291900928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319148.072714:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291901056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319148.072969:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319148.087404:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291901056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319148.091300:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319148.091316:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319148.091321:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291900928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319148.321007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319148.386929:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319149.345015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319149.410963:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319150.369367:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319150.434987:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319151.398781:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319151.457066:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319152.417023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319152.481154:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319153.185046:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319153.185056:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319153.185059:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319153.185063:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319153.185067:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319153.185078:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4052 00000100:00080000:3.0:1767319153.185089:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319153.185096:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319153.185108:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319153.185144:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291901184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319153.185236:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319153.185258:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291901312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319153.186184:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319153.189412:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291901312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319153.190966:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319153.190977:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319153.190983:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319153.441015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319153.505023:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319154.467031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319154.529556:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319155.488991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319155.555128:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319156.513019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319156.578910:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319157.536997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319157.607858:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319158.305019:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319158.305030:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319158.305051:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319158.305055:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319158.305059:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319158.305068:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4058 00000100:00080000:3.0:1767319158.305080:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319158.305087:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319158.305098:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319158.305130:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291901440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319158.305240:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319158.305256:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291901568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319158.306218:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319158.310177:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291901568:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319158.319599:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319158.319616:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319158.319622:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319158.561904:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319158.628798:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319159.585324:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319159.649588:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319160.609725:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319160.678529:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319161.633014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319161.697080:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319162.402544:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319137/real 1767319137] req@ffff8c3c46ab3b80 x1853164291900544/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319162.402580:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3b80 x1853164291900544/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319162.402602:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319162.402632:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319162.402636:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291900544:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319162.402734:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319162.402740:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319162.402743:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319162.402749:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4042 00000100:00080000:3.0:1767319162.402758:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319162.402764:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319162.402810:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291901696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319162.402835:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319162.402839:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319162.402841:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319162.402844:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4063 00000100:00080000:3.0:1767319162.402848:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319162.402852:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319162.402901:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319162.402914:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291901824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319162.403054:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291901696:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319162.403150:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319162.403429:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291901952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319162.413174:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291901952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319162.414504:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319162.414521:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319162.414526:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291901824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319162.657019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319162.723017:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319163.681442:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319163.749660:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319164.704992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319164.769111:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319165.729018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319165.793749:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319166.758243:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319166.817179:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319167.521072:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319167.521087:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319167.521090:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319167.521095:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319167.521101:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319167.521116:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4067 00000100:00080000:3.0:1767319167.521130:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319167.521139:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319167.521154:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319167.521200:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291902080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319167.521478:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291902208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319167.521631:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902080:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319167.526970:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319167.526988:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319167.526994:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319167.528260:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291902208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319167.777791:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319167.841724:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319168.801047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319168.865786:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319169.825045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319169.891379:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319170.849031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319170.913321:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319171.873469:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319171.937356:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319172.641144:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319172.641157:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319172.641160:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319172.641165:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319172.641170:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319172.641184:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4072 00000100:00080000:1.0:1767319172.641197:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319172.641206:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319172.641246:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319172.641287:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291902336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319172.641429:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291902464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319172.641591:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319172.666998:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291902464:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319172.667134:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319172.667141:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319172.667146:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319172.897108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319172.964595:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319173.922692:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319173.985180:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319174.945451:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319175.009221:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319175.969086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319176.034278:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319176.993011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319177.057089:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319177.761262:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319177.761273:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319177.761276:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319177.761288:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319177.761293:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319177.761303:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4077 00000100:00080000:0.0:1767319177.761314:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319177.761322:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319177.761333:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319177.761368:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291902592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319177.761447:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319177.761463:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291902720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319177.765466:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319177.774589:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291902720:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319177.774703:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319177.774710:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319177.774714:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319178.017499:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319178.082085:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319179.041071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319179.105073:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319180.065713:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319180.129705:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319181.090828:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319181.153318:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319182.115549:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319182.177043:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319182.881443:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319182.881452:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319182.881456:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319182.881460:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319182.881464:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319182.881474:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4082 00000100:00080000:3.0:1767319182.881502:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319182.881512:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319182.881523:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319182.881550:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291902848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319182.881719:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291902976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319182.881949:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319182.892529:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291902976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319182.898333:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319182.898357:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319182.898389:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291902848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319183.137114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319183.201246:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319184.163572:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319184.227063:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319185.185469:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319185.249263:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319186.209007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319186.273024:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319187.233111:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319187.297411:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319188.003965:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319162/real 1767319162] req@ffff8c3c58fc1c00 x1853164291901696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319188.004000:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1c00 x1853164291901696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319188.004019:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319188.004049:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319188.004063:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291901696:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319188.007329:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319188.007341:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319188.007346:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319188.007355:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4067 00000100:00080000:0.0:1767319188.007367:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319188.007374:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319188.007415:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291903104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319188.007455:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319188.007459:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319188.007461:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319188.007465:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4087 00000100:00080000:0.0:1767319188.007469:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319188.007472:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319188.007482:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319188.007494:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291903232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319188.007547:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319188.007573:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291903360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319188.009117:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291903104:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319188.009196:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903232:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319188.014812:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319188.014826:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319188.014832:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319188.015498:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291903360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319188.257086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319188.321176:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319189.281037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319189.348813:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319190.306349:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319190.372554:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319191.329422:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319191.396224:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319192.353006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319192.417124:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319193.121075:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319193.121090:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319193.121094:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319193.121098:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319193.121104:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319193.121117:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4092 00000100:00080000:3.0:1767319193.121132:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319193.121153:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319193.121169:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319193.121219:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291903488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319193.121375:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291903616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319193.124457:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319193.125159:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291903616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319193.126557:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319193.126573:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319193.126579:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319193.379786:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319193.441293:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319194.401000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319194.465200:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319195.425001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319195.489158:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319196.451225:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319196.514695:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319197.473288:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319197.537593:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319198.241024:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319198.241040:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319198.241053:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319198.241084:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319198.241090:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319198.241112:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4098 00000100:00080000:3.0:1767319198.241127:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319198.241136:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319198.241152:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319198.241196:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291903744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319198.241283:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319198.241458:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291903872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319198.246474:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319198.246490:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319198.246495:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291903744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319198.248002:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291903872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319198.497013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319198.565004:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319199.520985:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319199.585176:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319200.547156:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319200.612097:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319201.569355:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319201.633230:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319202.595185:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319202.666758:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319203.361000:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319203.361010:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319203.361014:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319203.361018:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319203.361022:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319203.361033:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4103 00000100:00080000:3.0:1767319203.361043:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319203.361063:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319203.361075:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319203.361113:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291904000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319203.363187:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291904128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319203.367300:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904000:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319203.371953:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319203.371969:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319203.371974:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319203.372577:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291904128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319203.619016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319203.681299:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319204.641067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319204.705151:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319205.665011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319205.729678:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319206.689071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319206.754637:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319207.713318:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319207.780585:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319208.483676:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319208.483690:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319208.483717:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319208.483721:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319208.483727:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319208.483740:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4108 00000100:00080000:0.0:1767319208.483754:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319208.483763:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319208.483778:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319208.483822:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291904256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319208.483935:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291904384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319208.484363:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319208.490796:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291904384:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319208.493523:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319208.493544:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319208.493551:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319208.737023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319208.801192:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319209.761271:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319209.825636:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319210.785026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319210.849295:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319211.809070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319211.873609:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319212.833038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319212.899800:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319213.601008:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319213.601019:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319213.601022:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319213.601026:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319213.601029:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319213.601040:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4113 00000100:00080000:0.0:1767319213.601051:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319213.601058:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319213.601070:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319213.601106:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291904512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319213.601218:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291904640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319213.601266:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319188/real 1767319188] req@ffff8c3c50e9df80 x1853164291903104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319213 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319213.601315:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9df80 x1853164291903104/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319213 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319213.601359:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904512:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319213.601443:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319213.601490:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319213.601495:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291903104:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319213.601938:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319213.601944:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319213.601948:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319213.601964:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4092 00000100:00080000:0.0:1767319213.601971:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319213.601977:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319213.602005:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291904768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319213.602206:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291904768:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319213.610195:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1767319213.610210:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291904640:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319213.610217:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319213.610230:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319213.857034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319213.921068:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319214.881011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319214.945323:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319215.905041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319215.972469:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319216.930121:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319216.993130:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319217.953081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319218.017306:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319218.721037:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319218.721051:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319218.721054:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319218.721059:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319218.721065:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319218.721078:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4118 00000100:00080000:0.0:1767319218.721093:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319218.721101:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319218.721116:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319218.721163:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291904896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319218.721278:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319218.722925:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319218.735799:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905024:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319218.742624:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319218.742647:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319218.742654:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291904896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319218.981580:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319219.041134:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319220.003493:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319220.067256:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319221.025009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319221.090249:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319222.049014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319222.113127:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319223.073262:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319223.137206:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319223.841013:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319223.841024:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319223.841027:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319223.841031:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319223.841035:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319223.841058:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4123 00000100:00080000:0.0:1767319223.841069:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319223.841077:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319223.841096:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319223.841131:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291905152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319223.841218:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291905280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319223.841601:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905152:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319223.849136:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319223.849151:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319223.849156:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319223.849304:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291905280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319224.096991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319224.161132:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319225.127727:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319225.185038:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319226.145009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319226.209083:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319227.169350:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319227.233373:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319228.192988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319228.257207:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319228.961325:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319228.961335:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319228.961339:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319228.961342:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319228.961346:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319228.961374:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4128 00000100:00080000:0.0:1767319228.961384:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319228.961391:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319228.961402:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319228.961432:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291905408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319228.961652:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319228.961766:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319228.970630:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905536:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319228.975398:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319228.975414:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319228.975419:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319229.216977:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319229.281213:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319230.241003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319230.305177:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319231.265089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319231.329246:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319232.289040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319232.353330:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319233.313051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319233.377256:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319234.081687:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319234.081703:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319234.081707:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319234.081712:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319234.081717:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319234.081732:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4133 00000100:00080000:0.0:1767319234.081746:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319234.081756:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319234.081781:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319234.081831:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291905664/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319234.082165:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319234.082184:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319234.082405:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905664:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319234.092467:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319234.092476:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291905792:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319234.092479:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319234.092484:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291905664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319234.337026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319234.401087:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319235.361055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319235.425120:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319236.385047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319236.449210:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319237.409025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319237.473172:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319238.177055:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319213/real 1767319213] req@ffff8c3c50e9d180 x1853164291904768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319238.177089:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9d180 x1853164291904768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319238.177107:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319238.177136:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319238.177140:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291904768:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319238.177315:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319238.177321:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319238.177323:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319238.177328:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4118 00000100:00080000:3.0:1767319238.177337:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319238.177343:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319238.177377:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291905920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319238.177603:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319238.177608:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319238.177610:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319238.177615:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4138 00000100:00080000:3.0:1767319238.177619:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319238.177624:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319238.177633:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319238.177646:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291906048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319238.177808:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319238.177840:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291905920:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319238.177934:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319238.190002:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906176:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319238.196698:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319238.196713:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319238.196718:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319238.432991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319238.497152:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319239.457177:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319239.521563:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319240.481002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319240.545292:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319241.505001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319241.569345:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319242.529031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319242.596261:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319243.297065:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319243.297074:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319243.297077:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319243.297081:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319243.297085:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319243.297110:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4143 00000100:00080000:3.0:1767319243.297121:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319243.297315:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319243.297329:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319243.297362:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291906304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319243.297442:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319243.297460:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319243.297913:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319243.314446:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319243.314461:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319243.314467:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319243.314725:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319243.552990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319243.617359:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319244.577002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319244.641089:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319245.601002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319245.665282:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319246.627941:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319246.689132:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319247.648998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319247.713341:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319248.417227:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319248.417238:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319248.417241:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319248.417245:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319248.417249:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319248.417259:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4148 00000100:00080000:0.0:1767319248.417269:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319248.417276:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319248.417302:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319248.417331:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291906560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319248.417398:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319248.417819:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319248.417829:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291906688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319248.428344:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291906688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319248.428460:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319248.428467:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319248.428471:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319248.673260:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319248.737259:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319249.697001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319249.764853:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319250.723970:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319250.785179:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319251.745005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319251.809248:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319252.769041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319252.833177:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319253.537429:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319253.537443:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319253.537446:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319253.537450:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319253.537455:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319253.537465:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4153 00000100:00080000:3.0:1767319253.537475:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319253.537482:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319253.537494:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319253.537529:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291906816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319253.537639:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319253.537640:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906816:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319253.542090:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319253.542104:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319253.542110:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291906816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319253.560733:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291906944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319253.793014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319253.857942:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319254.817014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319254.881152:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319255.841022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319255.905401:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319256.865004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319256.929504:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319257.889014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319257.957666:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319258.657392:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319258.657407:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319258.657411:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319258.657416:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319258.657422:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319258.657435:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4158 00000100:00080000:0.0:1767319258.657449:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319258.657458:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319258.657473:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319258.657519:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291907072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319258.657606:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291907200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319258.657816:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319258.664864:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291907200:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319258.665070:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319258.665079:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319258.665083:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319258.913014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319258.978178:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319259.937213:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319260.001304:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319260.961194:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319261.025242:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319261.984998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319262.052145:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319263.009014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319263.077015:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319263.777053:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319263.777080:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319263.777083:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319263.777087:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319263.777092:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319263.777115:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4163 00000100:00080000:3.0:1767319263.777127:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319263.777134:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319263.777146:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319263.777175:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291907328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319263.777329:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319238/real 1767319238] req@ffff8c3c58fc2680 x1853164291905920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319263.777332:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291907456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319263.777356:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291905920/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319263.777370:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907328:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319263.779949:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319263.780045:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319263.780052:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291905920:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319263.782984:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319263.782995:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319263.782999:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319263.783008:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4143 00000100:00080000:3.0:1767319263.783019:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319263.783026:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319263.783065:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291907584/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319263.783239:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291907584:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319263.790812:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291907456:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319263.796558:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319263.796576:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319263.796582:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319264.034862:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319264.097256:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319265.057637:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319265.122242:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319266.080959:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319266.145581:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319267.106748:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319267.169170:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319268.131738:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319268.193069:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319268.897797:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319268.897805:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319268.897808:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319268.897824:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319268.897827:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319268.897837:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4168 00000100:00080000:3.0:1767319268.897848:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319268.897855:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319268.898009:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319268.898038:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291907712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319268.898112:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319268.898745:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319268.898769:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291907840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319268.903487:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291907840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319268.904199:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319268.904224:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319268.904228:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319269.153699:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319269.217199:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319270.177009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319270.241143:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319271.201009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319271.265100:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319272.225696:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319272.289491:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319273.249006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319273.313709:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319274.017013:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319274.017023:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319274.017026:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319274.017031:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319274.017035:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319274.017045:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4173 00000100:00080000:3.0:1767319274.017055:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319274.017061:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319274.017072:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319274.017105:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291907968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319274.017388:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319274.018913:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319274.021516:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319274.021532:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319274.021538:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291907968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319274.023255:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319274.273056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319274.337287:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319275.297011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319275.361566:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319276.321043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319276.385476:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319277.344995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319277.409464:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319278.368981:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319278.433891:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319279.137063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319279.137073:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319279.137076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319279.137080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319279.137085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319279.137105:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4178 00000100:00080000:2.0:1767319279.137117:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319279.137124:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319279.137135:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319279.137172:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291908224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319279.137266:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319279.137283:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319279.138077:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319279.142184:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319279.144948:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319279.144966:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319279.144972:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319279.393220:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319279.457263:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319280.416995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319280.481811:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319281.441003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319281.508685:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319282.467102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319282.532538:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319283.489001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319283.553857:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319284.257767:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319284.257778:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319284.257781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319284.257784:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319284.257788:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319284.257799:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4184 00000100:00080000:3.0:1767319284.257811:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319284.257817:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319284.257830:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319284.257862:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291908480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319284.257983:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319284.257997:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291908608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319284.258044:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908480:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319284.275396:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319284.275411:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319284.275416:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319284.277621:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291908608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319284.513009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319284.577667:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319285.537152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319285.601087:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319286.561007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319286.625338:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319287.585000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319287.653678:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319288.353107:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319263/real 1767319263] req@ffff8c3c58fc2680 x1853164291907584/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319288.353157:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291907584/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319288.353176:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319288.353200:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319288.353205:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291907584:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319288.354466:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319288.354473:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319288.354477:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319288.354483:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4168 00000100:00080000:3.0:1767319288.354492:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319288.354499:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319288.354529:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291908736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319288.354554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319288.354566:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319288.354568:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319288.354573:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4189 00000100:00080000:3.0:1767319288.354577:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319288.354581:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319288.354589:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319288.354601:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291908864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319288.354657:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319288.354671:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319288.354679:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291908736:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319288.356801:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319288.363436:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291908992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319288.367147:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319288.367161:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319288.367167:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291908864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319288.608976:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319288.673350:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319289.633045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319289.698396:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319290.660426:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319290.721852:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319291.681175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319291.748745:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319292.705007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319292.769531:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319293.475144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319293.475153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319293.475157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319293.475161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319293.475165:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319293.475175:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4193 00000100:00080000:3.0:1767319293.475186:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319293.475193:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319293.475205:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319293.475265:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291909120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319293.477254:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291909248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319293.477377:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319293.485993:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291909248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319293.489729:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319293.489743:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319293.489748:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319293.730638:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319293.793518:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319294.753028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319294.817264:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319295.777507:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319295.841211:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319296.801576:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319296.865312:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319297.826433:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319297.889153:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319298.594166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319298.594185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319298.594188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319298.594192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319298.594196:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319298.594206:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4198 00000100:00080000:1.0:1767319298.594216:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319298.594223:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319298.594234:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319298.594350:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291909376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319298.594425:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319298.595243:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319298.595267:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291909504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319298.602738:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291909504:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319298.603594:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319298.603602:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319298.603606:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319298.849002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319298.913237:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319299.873008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319299.937310:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319300.898735:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319300.961436:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319301.921467:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319301.985812:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319302.945465:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319303.009234:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319303.713332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319303.713341:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319303.713344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319303.713348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319303.713352:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319303.713363:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4203 00000100:00080000:3.0:1767319303.713373:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319303.713380:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319303.713392:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319303.713427:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291909632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319303.713558:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319303.714214:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291909760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319303.724183:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291909760:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319303.724363:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319303.724371:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319303.724375:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319303.969319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319304.033124:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319304.994242:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319305.057179:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319306.017254:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319306.081027:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319307.041052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319307.107140:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319308.067481:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319308.129284:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319308.834034:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319308.834043:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319308.834063:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319308.834066:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319308.834070:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319308.834080:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4208 00000100:00080000:0.0:1767319308.834120:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319308.834127:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319308.834138:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319308.834171:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291909888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319308.834248:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291910016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319308.834428:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909888:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319308.840413:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319308.840428:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319308.840434:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291909888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319308.840529:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291910016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319309.089178:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319309.153242:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319310.113981:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319310.177108:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319311.137141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319311.201597:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319312.160999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319312.225078:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319313.185675:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319313.249217:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319313.953129:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319288/real 1767319288] req@ffff8c3c58fc3100 x1853164291908736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319313 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319313.953163:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3100 x1853164291908736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319313 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319313.953182:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319313.953190:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319313.953193:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291908736:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319313.954152:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319313.954159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319313.954162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319313.954169:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4193 00000100:00080000:3.0:1767319313.954179:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319313.954185:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319313.954215:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291910144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319313.954262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319313.954265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319313.954267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319313.954270:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4213 00000100:00080000:3.0:1767319313.954281:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319313.954285:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319313.954294:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319313.954306:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291910272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319313.954600:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291910144:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767319313.955120:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291910400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319313.955841:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910272:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319313.971192:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319313.971220:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319313.971226:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319313.977063:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291910400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319314.209260:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319314.273976:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319315.232989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319315.298035:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319316.259816:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319316.321182:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319317.281129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319317.345434:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319318.305008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319318.370396:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319319.076209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319319.076216:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319319.076219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319319.076222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319319.076226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319319.076238:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4218 00000100:00080000:3.0:1767319319.076249:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319319.076255:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319319.076265:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319319.076293:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291910528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319319.076347:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319319.076406:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291910656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319319.079326:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291910656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319319.079597:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319319.079602:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319319.079605:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319319.335215:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319319.393151:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319320.353160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319320.418152:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319321.377055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319321.441240:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319322.402369:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319322.465760:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319323.425916:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319323.489469:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319324.193024:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319324.193035:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319324.193038:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319324.193042:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319324.193046:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319324.193056:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4223 00000100:00080000:1.0:1767319324.193068:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319324.193086:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319324.193153:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319324.193189:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291910784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319324.198293:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291910912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319324.198342:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319324.228534:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291910912:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319324.228623:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319324.228630:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319324.228634:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291910784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319324.449010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319324.520338:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319325.475013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319325.542292:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319326.497023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319326.561179:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319327.524445:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319327.587475:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319328.547385:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319328.609487:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319329.313285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319329.313295:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319329.313298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319329.313301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319329.313306:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319329.313316:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4229 00000100:00080000:3.0:1767319329.313326:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319329.313334:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319329.313345:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319329.313377:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291911040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319329.313445:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319329.313459:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291911168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319329.313774:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319329.318602:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291911168:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319329.320133:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319329.320146:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319329.320152:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319329.572232:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319329.633024:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319330.593534:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319330.658045:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319331.617064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319331.681035:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319332.641001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319332.705653:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319333.664970:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319333.731101:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319334.433484:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319334.433494:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319334.433497:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319334.433501:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319334.433505:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319334.433516:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4234 00000100:00080000:0.0:1767319334.433527:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319334.433534:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319334.433547:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319334.433611:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291911296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319334.433915:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291911424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319334.434119:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319334.442294:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291911424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319334.450584:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319334.450599:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319334.450605:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319334.689001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319334.753938:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319335.713056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319335.777284:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319336.737017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319336.801785:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319337.761016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319337.825141:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319338.529096:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319313/real 1767319313] req@ffff8c3c58fc1c00 x1853164291910144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319338 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319338.529142:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1c00 x1853164291910144/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319338 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319338.529166:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319338.529198:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319338.529203:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291910144:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319338.529312:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319338.529318:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319338.529322:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319338.529328:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4218 00000100:00080000:0.0:1767319338.529339:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319338.529347:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319338.529386:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291911552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319338.529415:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319338.529420:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319338.529422:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319338.529425:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4239 00000100:00080000:0.0:1767319338.529429:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319338.529433:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319338.529443:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319338.529455:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291911680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319338.529515:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291911808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319338.530049:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291911552:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319338.530093:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319338.541332:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291911808:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319338.546177:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319338.546222:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319338.546228:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319338.785043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319338.849129:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319339.809153:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319339.873564:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319340.833037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319340.897406:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319341.857312:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319341.921707:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319342.881045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319342.945614:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319343.649570:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319343.649586:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319343.649615:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319343.649620:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319343.649625:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319343.649639:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4243 00000100:00080000:0.0:1767319343.649654:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319343.649663:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319343.649993:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319343.650034:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291911936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319343.650640:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291912064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319343.650914:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911936:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319343.654515:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319343.654536:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319343.654543:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291911936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319343.658031:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291912064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319343.906106:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319343.969452:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319344.929337:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319344.994264:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319345.953024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319346.017229:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319346.977077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319347.041446:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319348.001056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319348.065212:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319348.770264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319348.770278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319348.770281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319348.770310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319348.770316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319348.770329:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4248 00000100:00080000:2.0:1767319348.770344:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319348.770352:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319348.770368:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319348.770410:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291912192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319348.770538:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291912320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319348.773294:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912192:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319348.784314:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319348.784338:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319348.784345:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319348.785137:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291912320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319349.026129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319349.089333:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319350.049096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319350.114937:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319351.073052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319351.137216:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319352.097155:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319352.162296:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319353.121063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319353.185368:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319353.892758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319353.892768:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319353.892771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319353.892775:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319353.892780:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319353.892791:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4253 00000100:00080000:1.0:1767319353.892803:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1767319353.892811:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319353.892823:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319353.892859:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291912448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319353.893066:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319353.893522:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291912576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319353.900107:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291912576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319353.900208:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319353.900215:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319353.900220:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319354.146015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319354.210786:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319355.169001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319355.233865:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319356.193013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319356.257641:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319357.217083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319357.281503:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319358.241439:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319358.305260:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319359.011038:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319359.011050:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319359.011052:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319359.011056:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319359.011061:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319359.011073:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4258 00000100:00080000:0.0:1767319359.011110:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1767319359.011118:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319359.011130:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319359.011163:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291912704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319359.011237:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291912832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319359.011456:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912704:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319359.016952:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319359.016970:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319359.016990:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291912704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319359.023016:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291912832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319359.265018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319359.329106:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319360.289083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319360.353814:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319361.313072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319361.378882:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319362.337097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319362.401137:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319363.107490:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319338/real 1767319338] req@ffff8c3c50e9c380 x1853164291911552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319363.107541:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c380 x1853164291911552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319363.107580:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319363.107619:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319363.107624:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291911552:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319363.107715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319363.107727:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319363.107731:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319363.107741:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4243 00000100:00080000:1.0:1767319363.107750:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319363.107757:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319363.107795:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291912960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319363.107833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319363.107836:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319363.107838:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319363.107842:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4263 00000100:00080000:1.0:1767319363.107846:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767319363.107850:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319363.107859:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319363.107916:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291913088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319363.107991:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319363.108008:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291913216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319363.108806:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291912960:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319363.109014:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319363.120703:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291913216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319363.126960:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319363.126977:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319363.126982:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319363.361020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319363.425227:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319364.384999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319364.450077:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319365.409772:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319365.473429:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319366.432994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319366.497051:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319367.457884:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319367.527270:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319368.225041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319368.225053:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319368.225058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319368.225062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319368.225068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319368.225082:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4268 00000100:00080000:1.0:1767319368.225094:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319368.225102:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319368.225115:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319368.225153:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291913344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319368.225319:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319368.225338:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291913472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319368.225528:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319368.231653:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319368.231669:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319368.231674:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319368.232115:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291913472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319368.481033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319368.545964:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319369.505060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319369.571035:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319370.529331:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319370.599744:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319371.552991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319371.617253:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319372.577009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319372.641143:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319373.346365:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319373.346380:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319373.346383:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319373.346388:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319373.346393:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319373.346409:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4273 00000100:00080000:0.0:1767319373.346424:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319373.346434:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319373.346450:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319373.346517:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291913600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319373.346598:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319373.346614:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291913728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319373.346937:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319373.364292:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319373.364314:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319373.364321:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319373.367762:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291913728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319373.601095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319373.666235:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319374.627638:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319374.691070:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319375.649023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319375.713514:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319376.675168:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319376.737359:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319377.697031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319377.765036:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319378.465036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319378.465047:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319378.465049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319378.465053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319378.465058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319378.465070:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4278 00000100:00080000:1.0:1767319378.465088:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319378.465095:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319378.465135:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319378.465188:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291913856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319378.465296:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319378.465312:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291913984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319378.467731:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319378.468170:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291913984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319378.477213:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319378.477232:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319378.477238:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291913856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319378.722386:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319378.785648:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319379.751458:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319379.809243:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319380.769057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319380.840863:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319381.796218:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319381.857544:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319382.817362:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319382.881232:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319383.585309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319383.585323:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319383.585326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319383.585331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319383.585336:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319383.585350:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4283 00000100:00080000:2.0:1767319383.585364:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319383.585396:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319383.585421:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319383.585475:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291914112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319383.585745:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291914240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319383.587498:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319383.589949:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291914240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319383.595040:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319383.595076:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319383.595083:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319383.841175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319383.906746:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319384.867933:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319384.929735:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319385.889050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319385.953416:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319386.913688:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319386.977503:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319387.938265:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319388.001728:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319388.705679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319388.705703:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319388.705706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319388.705711:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319388.705716:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319388.705735:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4288 00000100:00080000:2.0:1767319388.705749:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319388.705757:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319388.705772:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319388.705816:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291914368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319388.706402:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291914496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319388.706576:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319363/real 1767319363] req@ffff8c3c46ab0e00 x1853164291912960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319388 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319388.706606:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0e00 x1853164291912960/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319388 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319388.706621:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319388.706654:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319388.708885:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319388.708899:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291912960:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319388.716395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319388.716409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319388.716414:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319388.716426:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4268 00000100:00080000:1.0:1767319388.716441:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319388.716448:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319388.716509:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291914624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319388.716815:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291914624:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319388.721785:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319388.721804:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319388.721810:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319388.722342:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291914496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319388.962932:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319389.026482:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319389.985466:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319390.049241:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319391.009905:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319391.077926:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319392.033090:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319392.097354:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319393.057046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319393.121800:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319393.826289:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319393.826303:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319393.826306:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319393.826321:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319393.826328:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319393.826345:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4293 00000100:00080000:0.0:1767319393.826361:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319393.826370:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319393.826386:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319393.826432:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291914752/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319393.826531:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319393.827391:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319393.827411:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291914880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319393.841814:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291914880:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319393.847657:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319393.847680:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319393.847687:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291914752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319394.081060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319394.146930:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319395.107172:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319395.169572:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319396.129276:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319396.193808:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319397.157272:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319397.217932:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319398.177324:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319398.241238:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319398.946279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319398.946351:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319398.946355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319398.946359:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319398.946363:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319398.946374:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4298 00000100:00080000:2.0:1767319398.946385:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319398.946395:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319398.946407:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319398.946544:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291915008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319398.946629:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319398.946802:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291915136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319398.956633:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291915136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319398.957185:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319398.957192:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319398.957196:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319399.201203:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319399.265210:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319400.225017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319400.289603:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319401.249419:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319401.313257:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319402.273393:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319402.337161:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319403.297047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319403.364077:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319404.065055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319404.065069:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319404.065103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319404.065109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319404.065114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319404.065127:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4303 00000100:00080000:2.0:1767319404.065141:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319404.065148:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319404.065162:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319404.065201:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291915264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319404.065301:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291915392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319404.065799:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915264:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319404.069620:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319404.069642:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319404.069648:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319404.069767:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291915392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319404.321041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319404.388802:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319405.346397:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319405.409421:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319406.369274:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319406.433426:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319407.393070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319407.457528:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319408.417031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319408.487830:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319409.185258:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319409.185273:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319409.185276:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319409.185281:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319409.185287:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319409.185302:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4308 00000100:00080000:1.0:1767319409.185317:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319409.185329:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319409.185344:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319409.185393:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291915520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319409.185494:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291915648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319409.185767:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915520:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319409.190087:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319409.190102:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319409.190107:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319409.190234:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291915648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319409.444524:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319409.506671:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319410.465014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319410.531599:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319411.489019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319411.553144:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319412.513032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319412.577620:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319413.281017:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319388/real 1767319388] req@ffff8c3c46ab1180 x1853164291914624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319413.281054:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab1180 x1853164291914624/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319413.281109:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319413.281161:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319413.281166:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291914624:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319413.281260:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319413.281266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319413.281269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319413.281274:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4293 00000100:00080000:2.0:1767319413.281283:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319413.281296:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319413.281328:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291915776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319413.281355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319413.281359:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319413.281361:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319413.281364:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4314 00000100:00080000:2.0:1767319413.281369:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319413.281373:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319413.281382:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319413.281395:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291915904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319413.281446:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291916032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319413.281710:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291915776:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319413.281753:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319413.285528:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291916032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319413.292352:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319413.292368:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319413.292373:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291915904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319413.540343:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319413.601074:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319414.561018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319414.626199:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319415.585556:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319415.654515:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319416.609035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319416.673220:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319417.633587:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319417.701124:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319418.400998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319418.401008:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319418.401011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319418.401015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319418.401035:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319418.401046:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4318 00000100:00080000:2.0:1767319418.401056:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319418.401074:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319418.401098:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319418.401129:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291916160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319418.401192:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319418.401261:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291916288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319418.404059:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291916288:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319418.404326:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319418.404335:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319418.404340:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319418.657145:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319418.721487:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319419.681014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319419.745302:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319420.706202:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319420.772686:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319421.728997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319421.794249:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319422.753014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319422.817076:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319423.521153:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319423.521167:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319423.521170:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319423.521173:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319423.521178:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319423.521190:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4323 00000100:00080000:0.0:1767319423.521200:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319423.521209:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319423.521232:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319423.521268:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291916416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319423.521379:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319423.521962:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291916544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319423.528196:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319423.528212:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319423.528366:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319423.540458:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291916544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319423.777299:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319423.845252:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319424.801008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319424.865730:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319425.825003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319425.890164:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319426.849084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319426.913993:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319427.874852:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319427.937283:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319428.641611:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319428.641624:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319428.641628:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319428.641632:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319428.641638:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319428.641651:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4328 00000100:00080000:2.0:1767319428.641667:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319428.641676:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319428.641716:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319428.641773:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291916672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319428.642057:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291916800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319428.642551:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319428.645666:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291916800:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319428.650107:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319428.650124:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319428.650130:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319428.899784:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319428.962401:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319429.921077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319429.985230:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319430.945020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319431.015360:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319431.969026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319432.033192:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319432.993143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319433.058258:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319433.761991:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319433.762002:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319433.762005:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319433.762009:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319433.762013:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319433.762023:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4333 00000100:00080000:1.0:1767319433.762035:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319433.762042:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319433.762054:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319433.762086:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291916928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319433.762374:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319433.762441:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319433.762454:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291917056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319433.765383:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291917056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319433.765799:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319433.765807:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319433.765811:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291916928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319434.017018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319434.081217:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319435.041731:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319435.105856:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319436.065009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319436.129275:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319437.089311:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319437.153460:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319438.113114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319438.177341:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319438.881055:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319438.881066:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319438.881069:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319438.881073:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319438.881077:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319438.881088:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4338 00000100:00080000:2.0:1767319438.881100:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319438.881108:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319438.881119:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319438.881152:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291917184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319438.881253:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319413/real 1767319413] req@ffff8c3c5a288a80 x1853164291915776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319438.881281:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288a80 x1853164291915776/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319438.881303:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917184:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319438.881454:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319438.881473:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319438.881476:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291917312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319438.881478:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291915776:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319438.881523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319438.881527:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319438.881530:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319438.881534:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4318 00000100:00080000:0.0:1767319438.881539:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319438.881543:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319438.881582:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291917440/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319438.881676:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291917440:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319438.889657:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291917312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319438.889766:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319438.889774:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319438.889778:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319439.139683:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319439.204356:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319440.162135:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319440.225134:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319441.186351:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319441.249771:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319442.209570:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319442.275348:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319443.234419:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319443.297332:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319444.003151:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319444.003163:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319444.003166:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319444.003170:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319444.003174:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319444.003185:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4343 00000100:00080000:2.0:1767319444.003197:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319444.003206:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319444.003218:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319444.003253:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291917568/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319444.003336:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319444.003349:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291917696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319444.003624:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319444.015010:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291917696:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319444.015506:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319444.015524:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319444.015532:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319444.257017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319444.325488:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319445.281159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319445.345183:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319446.305046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319446.369908:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319447.329029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319447.393619:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319448.353045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319448.417419:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319449.122095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319449.122106:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319449.122110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319449.122114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319449.122119:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319449.122131:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4348 00000100:00080000:0.0:1767319449.122143:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319449.122151:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319449.122162:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319449.122197:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291917824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319449.122283:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319449.122285:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319449.122300:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291917952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319449.130842:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319449.130859:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319449.130865:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291917824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319449.131602:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291917952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319449.377032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319449.441147:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319450.401085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319450.468522:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319451.425156:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319451.490518:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319452.449126:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319452.513763:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319453.475004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319453.537897:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319454.241422:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319454.241434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319454.241437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319454.241441:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319454.241447:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319454.241458:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4354 00000100:00080000:2.0:1767319454.241470:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319454.241477:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319454.241490:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319454.241529:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291918080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319454.241653:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291918208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319454.241789:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918080:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319454.249732:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767319454.249732:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291918208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319454.249753:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319454.249769:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319454.497114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319454.561073:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319455.520995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319455.585393:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319456.546067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319456.609394:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319457.568976:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319457.633112:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319458.593020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319458.657356:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319459.360997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319459.361008:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319459.361011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319459.361015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319459.361037:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319459.361048:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4359 00000100:00080000:2.0:1767319459.361059:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319459.361066:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319459.361078:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319459.361112:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291918336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319459.361170:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319459.361184:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291918464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319459.361193:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918336:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319459.365792:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319459.365809:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319459.365815:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319459.366956:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291918464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319459.618823:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319459.682324:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319460.641643:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319460.707084:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319461.665601:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319461.731560:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319462.689047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319462.758227:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319463.457153:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319438/real 1767319438] req@ffff8c3c50e9c000 x1853164291917440/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319463 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319463.457198:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c000 x1853164291917440/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319463 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319463.457222:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319463.457313:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767319463.457319:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291917440:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319463.462412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319463.462426:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319463.462432:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319463.462446:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4343 00000100:00080000:0.0:1767319463.462460:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319463.462469:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319463.462531:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291918592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319463.462570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319463.462574:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319463.462576:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319463.462581:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4364 00000100:00080000:0.0:1767319463.462585:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319463.462589:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319463.462600:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319463.462635:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291918720/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319463.462774:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291918848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319463.462811:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291918592:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767319463.462952:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319463.472588:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291918848:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319463.480310:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319463.480371:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319463.480379:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319463.713449:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319463.777128:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319464.737919:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319464.801161:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319465.763366:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319465.825561:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319466.785263:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319466.849828:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319467.810393:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319467.877111:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319468.577682:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319468.577696:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319468.577699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319468.577704:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319468.577710:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319468.577723:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4368 00000100:00080000:2.0:1767319468.577738:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319468.577747:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319468.577761:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319468.577813:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291918976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319468.577921:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319468.577943:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291919104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319468.578268:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319468.606082:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291919104:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319468.615260:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319468.615282:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319468.615289:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291918976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319468.833056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319468.901356:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319469.857068:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319469.922075:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319470.883893:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319470.945151:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319471.905362:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319471.969310:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319472.929601:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319472.995143:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319473.697320:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319473.697336:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319473.697340:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319473.697345:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319473.697351:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319473.697364:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4373 00000100:00080000:1.0:1767319473.697379:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319473.697387:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319473.697402:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319473.697449:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291919232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319473.697542:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319473.697558:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291919360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319473.698108:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919232:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319473.710289:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319473.710313:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319473.710320:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319473.710938:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291919360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319473.953042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319474.017607:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319474.977133:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319475.043758:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319476.001008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319476.065129:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319477.024957:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319477.090629:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319478.049287:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319478.115017:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319478.817058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319478.817070:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319478.817073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319478.817077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319478.817082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319478.817092:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4378 00000100:00080000:0.0:1767319478.817114:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319478.817122:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319478.817134:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319478.817171:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291919488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319478.817249:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319478.817261:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291919616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319478.817593:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319478.826712:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291919616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319478.827338:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319478.827346:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319478.827351:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319479.074473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319479.137492:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319480.097090:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319480.161226:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319481.125186:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319481.185902:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319482.145000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319482.209676:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319483.172699:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319483.236155:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319483.938861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319483.938901:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319483.938905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319483.938910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319483.938916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319483.938930:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4383 00000100:00080000:2.0:1767319483.938945:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319483.938954:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319483.938969:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319483.939012:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291919744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319483.939147:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291919872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319483.939711:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319483.944110:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291919872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319483.944274:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319483.944281:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319483.944286:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291919744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319484.193065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319484.260091:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319485.217191:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319485.281550:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319486.243454:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319486.305202:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319487.265060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319487.329254:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319488.033052:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319463/real 1767319463] req@ffff8c3c50e9fb80 x1853164291918592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319488.033104:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9fb80 x1853164291918592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319488.033129:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319488.033167:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319488.033172:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291918592:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319488.033281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319488.033288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319488.033291:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319488.033298:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4368 00000100:00080000:2.0:1767319488.033310:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319488.033318:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319488.033379:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291920000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319488.033442:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291920000:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319488.034723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319488.034732:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319488.034736:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319488.034745:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4388 00000100:00080000:2.0:1767319488.034754:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319488.034760:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319488.034776:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319488.034809:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291920128/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319488.039796:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319488.040368:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291920256:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319488.044960:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319488.044981:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319488.044987:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319488.045171:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291920256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319488.289254:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319488.354667:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319489.313026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319489.380471:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319490.337028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319490.401195:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319491.361006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319491.425550:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319492.384983:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319492.451718:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319493.153258:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319493.153272:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319493.153276:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319493.153305:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319493.153310:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319493.153324:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4392 00000100:00080000:1.0:1767319493.153339:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319493.153349:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319493.153365:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319493.153419:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291920384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319493.153502:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319493.153526:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291920512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319493.154008:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920384:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319493.161147:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319493.161169:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319493.161176:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319493.161388:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291920512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319493.411826:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319493.473573:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319494.434027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319494.497703:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319495.457251:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319495.521531:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319496.481042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319496.545204:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319497.505086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319497.569199:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319498.273520:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319498.273535:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319498.273538:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319498.273542:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319498.273548:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319498.273560:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4398 00000100:00080000:1.0:1767319498.273576:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319498.273585:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319498.273601:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319498.273668:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291920640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319498.273757:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291920768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319498.274403:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920640:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319498.278035:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319498.278056:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319498.278062:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319498.278187:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291920768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319498.529021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319498.594620:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319499.553247:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319499.618206:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319500.578022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319500.641362:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319501.601147:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319501.665546:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319502.624970:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319502.689343:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319503.393405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319503.393420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319503.393424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319503.393429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319503.393435:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319503.393449:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4403 00000100:00080000:1.0:1767319503.393465:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319503.393475:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319503.393490:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319503.393550:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291920896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319503.393775:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291921024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319503.393971:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920896:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319503.399451:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319503.399474:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319503.399480:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291920896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319503.399601:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291921024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319503.649495:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319503.713394:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319504.672988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319504.739192:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319505.697119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319505.764339:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319506.721050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319506.785337:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319507.745034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319507.810055:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319508.514506:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319508.514516:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319508.514519:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319508.514522:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319508.514527:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319508.514537:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4408 00000100:00080000:2.0:1767319508.514550:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319508.514557:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319508.514570:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319508.514615:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291921152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319508.514721:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319508.514743:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291921280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319508.514783:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921152:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319508.519343:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319508.519357:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319508.519363:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319508.521290:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291921280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319508.769044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319508.833612:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319509.793041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319509.857436:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319510.817360:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319510.881289:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319511.841571:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319511.905449:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319512.865119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319512.930629:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319513.633154:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319488/real 1767319488] req@ffff8c3c5a288000 x1853164291920000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319513.633192:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288000 x1853164291920000/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319513.633213:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319513.633316:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319513.633323:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291920000:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319513.635479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319513.635491:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319513.635495:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319513.635504:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4392 00000100:00080000:3.0:1767319513.635515:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319513.635522:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319513.635569:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291921408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319513.635601:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319513.635605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319513.635621:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319513.635626:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4413 00000100:00080000:3.0:1767319513.635630:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319513.635634:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319513.635644:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319513.635657:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291921536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319513.635730:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319513.635747:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291921664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319513.636252:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291921408:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319513.636293:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319513.639572:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291921664:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319513.640454:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319513.640811:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319513.640833:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319513.890326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319513.954932:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319514.914030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319514.979111:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319515.937096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319516.001839:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319516.961100:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319517.025625:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319517.985103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319518.052353:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319518.755921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319518.755936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319518.755940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319518.755944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319518.755951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319518.755966:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4418 00000100:00080000:1.0:1767319518.755980:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319518.755989:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319518.756005:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319518.756060:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291921792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319518.756250:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319518.756285:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291921920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319518.756463:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921792:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319518.759820:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319518.759843:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319518.759850:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291921792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319518.760261:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291921920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319519.010770:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319519.075551:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319520.033068:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319520.097375:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319521.057078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319521.121075:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319522.081029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319522.146679:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319523.107474:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319523.179241:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319523.873134:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319523.873149:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319523.873153:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319523.873157:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319523.873164:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319523.873178:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4423 00000100:00080000:3.0:1767319523.873199:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319523.873208:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319523.873226:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319523.873278:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291922048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319523.873636:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319523.873660:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319523.873674:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291922176:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319523.888185:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319523.888209:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319523.888216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319523.889847:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291922176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319524.129562:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319524.195340:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319525.153039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319525.219656:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319526.176997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319526.241164:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319527.201807:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319527.265617:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319528.226463:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319528.289151:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319528.993070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319528.993090:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319528.993093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319528.993097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319528.993102:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319528.993114:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4428 00000100:00080000:1.0:1767319528.993126:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319528.993150:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319528.993162:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319528.993194:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291922304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319528.993336:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291922432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319528.993358:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319528.996054:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291922432:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319528.996161:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319528.996166:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319528.996169:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319529.250636:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319529.313204:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319530.273008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319530.337685:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319531.297165:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319531.361162:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319532.323318:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319532.385122:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319533.347238:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319533.411258:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319534.116770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319534.116780:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319534.116784:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319534.116789:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319534.116794:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319534.116806:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4433 00000100:00080000:0.0:1767319534.116818:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319534.116826:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319534.116838:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319534.116931:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291922560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319534.117007:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319534.117025:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291922688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319534.117046:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922560:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319534.127943:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319534.127957:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319534.127960:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319534.133179:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291922688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319534.369078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319534.433176:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319535.393001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319535.458915:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319536.416957:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319536.481420:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319537.441804:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319537.505206:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319538.209055:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319513/real 1767319513] req@ffff8c3c58fc1f80 x1853164291921408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319538.209090:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1f80 x1853164291921408/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319538.209110:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319538.209140:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767319538.209144:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291921408:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319538.209226:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319538.209232:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319538.209239:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319538.209244:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4418 00000100:00080000:3.0:1767319538.209254:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319538.209260:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319538.209292:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291922816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319538.209315:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319538.209319:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319538.209321:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319538.209325:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4439 00000100:00080000:3.0:1767319538.209328:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319538.209332:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319538.209341:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319538.209352:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291922944/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319538.209412:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291923072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319538.211558:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291922816:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767319538.211664:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319538.220538:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291923072:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319538.224773:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319538.224788:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319538.224793:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291922944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319538.465014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319538.529111:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319539.489305:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319539.560590:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319540.514574:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319540.578992:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319541.537006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319541.601481:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319542.561345:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319542.625284:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319543.329407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319543.329417:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319543.329420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319543.329425:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319543.329429:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319543.329440:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4443 00000100:00080000:1.0:1767319543.329453:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319543.329480:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319543.329493:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319543.329534:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291923200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319543.329602:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319543.329613:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291923328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319543.329769:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319543.334154:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291923328:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319543.335728:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319543.335740:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319543.335745:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319543.585034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319543.650346:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319544.609186:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319544.673637:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319545.636172:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319545.697574:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319546.657438:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319546.721224:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319547.681357:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319547.745159:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319548.450138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319548.450148:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319548.450151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319548.450154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319548.450160:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319548.450169:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4448 00000100:00080000:1.0:1767319548.450181:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319548.450188:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319548.450199:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319548.450232:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291923456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319548.450525:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319548.450545:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291923584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319548.450753:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923456:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319548.461793:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319548.461810:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319548.461815:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319548.462276:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291923584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319548.705023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319548.769370:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319549.731201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319549.793126:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319550.753026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319550.819025:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319551.777006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319551.841175:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319552.801093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319552.865649:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319553.569045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319553.569055:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319553.569058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319553.569062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319553.569066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319553.569076:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4453 00000100:00080000:0.0:1767319553.569087:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319553.569094:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319553.569106:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319553.569139:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291923712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319553.569218:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319553.569231:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291923840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319553.569303:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923712:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319553.573404:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319553.573410:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291923840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319553.573426:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319553.573432:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319553.825207:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319553.892120:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319554.848989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319554.913160:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319555.873029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319555.937603:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319556.897403:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319556.961245:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319557.923612:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319557.987069:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319558.695015:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319558.695027:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319558.695030:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319558.695034:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319558.695039:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319558.695049:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4458 00000100:00080000:0.0:1767319558.695061:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319558.695069:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319558.695081:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319558.695130:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291923968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319558.695311:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291924096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319558.695903:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319558.700472:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291924096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319558.700583:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319558.700592:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319558.700596:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291923968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319558.946064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319559.009403:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319559.972045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319560.033378:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319560.993047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319561.057227:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319562.017045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319562.081196:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319563.041172:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319563.106140:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319563.809086:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319538/real 1767319538] req@ffff8c3c58fc0700 x1853164291922816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319563.809145:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0700 x1853164291922816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319563.809168:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319563.809179:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319563.809218:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291922816:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319563.809806:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319563.809813:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319563.809817:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319563.809825:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4443 00000100:00080000:2.0:1767319563.809838:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319563.809845:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319563.809915:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291924224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319563.809942:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319563.809946:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319563.809948:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319563.809952:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4463 00000100:00080000:2.0:1767319563.809965:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319563.809969:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319563.809980:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319563.809993:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291924352/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319563.810067:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291924480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319563.811469:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291924224:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319563.811564:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319563.814040:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291924480:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319563.814388:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319563.814397:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319563.814401:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319564.066146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319564.129311:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319565.089201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319565.153330:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319566.116185:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319566.177306:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319567.138780:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319567.201755:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319568.161380:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319568.228289:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319568.929334:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319568.929352:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319568.929355:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319568.929360:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319568.929365:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319568.929379:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4468 00000100:00080000:2.0:1767319568.929394:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319568.929403:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319568.929420:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319568.929472:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291924608/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319568.929595:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319568.929633:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291924736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319568.929679:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924608:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319568.934663:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319568.934679:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319568.934685:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319568.935047:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291924736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319569.185815:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319569.249424:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319570.209071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319570.273216:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319571.234086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319571.297167:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319572.257248:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319572.321211:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319573.281127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319573.345340:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319574.049258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319574.049271:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319574.049274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319574.049279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319574.049364:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319574.049379:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4473 00000100:00080000:0.0:1767319574.049393:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319574.049401:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319574.049416:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319574.049460:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291924864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319574.049586:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291924992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319574.050492:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319574.062009:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291924992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319574.062927:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319574.062942:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319574.062948:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291924864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319574.305698:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319574.370484:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319575.331073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319575.393112:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319576.355791:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319576.424482:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319577.376999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319577.441226:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319578.401011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319578.465526:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319579.170321:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319579.170332:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319579.170335:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319579.170339:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319579.170343:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319579.170353:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4478 00000100:00080000:3.0:1767319579.170365:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319579.170372:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319579.170382:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319579.170416:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291925120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319579.170492:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319579.170508:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291925248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319579.170908:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319579.176554:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291925248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319579.177190:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319579.177196:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319579.177199:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319579.425268:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319579.490109:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319580.449915:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319580.513276:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319581.475927:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319581.537080:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319582.497003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319582.561167:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319583.520967:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319583.585218:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319584.292288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319584.292299:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319584.292302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319584.292305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319584.292310:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319584.292319:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4484 00000100:00080000:3.0:1767319584.292331:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319584.292355:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319584.292367:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319584.292402:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291925376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319584.292476:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319584.292485:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291925504:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319584.361017:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319584.361038:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319584.361384:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291925504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319584.361802:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319584.545017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319584.612841:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319585.572119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319585.633174:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319586.592996:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319586.657331:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319587.617073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319587.683479:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319588.449031:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319563/real 1767319563] req@ffff8c3c5a289c00 x1853164291924224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319588.449067:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289c00 x1853164291924224/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319588.449086:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319588.449233:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319588.449238:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291924224:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319588.449426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319588.449432:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319588.449436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319588.449441:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4468 00000100:00080000:3.0:1767319588.449449:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319588.449455:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319588.449487:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291925632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319588.449579:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291925632:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319588.449698:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319588.449702:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319588.449704:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319588.449708:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4489 00000100:00080000:3.0:1767319588.449713:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319588.449717:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319588.449726:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319588.449739:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291925760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319588.450044:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291925888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319588.450189:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925760:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319588.457651:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319588.457668:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319588.457673:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291925760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319588.458094:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291925888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319588.642633:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319588.706063:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319589.665001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319589.729073:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319590.689062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319590.753100:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319591.713081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319591.777127:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319592.737037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319592.801416:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319593.506758:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319593.506767:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319593.506770:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319593.506775:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319593.506779:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319593.506789:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4493 00000100:00080000:0.0:1767319593.506799:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319593.506824:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319593.506836:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319593.506868:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291926016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319593.506996:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291926144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319593.507041:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319593.514182:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291926144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319593.515863:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319593.515910:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319593.515916:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319593.761040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319593.836219:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319594.786813:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319594.851446:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319595.809397:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319595.873187:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319596.832995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319596.898311:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319597.857030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319597.930208:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319598.625844:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319598.625900:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319598.625904:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319598.625908:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319598.625912:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319598.625922:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4498 00000100:00080000:2.0:1767319598.625933:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319598.625939:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319598.625950:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319598.625982:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291926272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319598.626050:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319598.626174:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319598.626185:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319598.636635:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319598.638282:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319598.638294:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319598.638299:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319598.881004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319598.945179:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319599.905598:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319599.969347:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319600.931519:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319600.993062:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319601.953141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319602.017073:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319602.977194:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319603.041266:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319603.744932:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319603.744942:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319603.744945:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319603.744948:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319603.744953:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319603.744961:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4503 00000100:00080000:2.0:1767319603.744970:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319603.744976:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319603.745004:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319603.745039:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291926528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319603.745327:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319603.745629:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319603.754980:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319603.754996:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319603.755001:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319603.755104:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319604.001234:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319604.066542:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319605.024994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319605.089294:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319606.050099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319606.113759:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319607.080133:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319607.137905:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319608.096960:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319608.162073:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319608.869064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319608.869150:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319608.869187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319608.869192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319608.869197:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319608.869210:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4508 00000100:00080000:3.0:1767319608.869223:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319608.869232:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319608.869246:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319608.869287:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291926784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319608.869405:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319608.869419:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319608.869425:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319608.880442:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291926912:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319608.880550:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319608.880559:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319608.880563:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291926784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319609.121619:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319609.189036:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319610.145055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319610.210323:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319611.169029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319611.233511:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319612.193038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319612.259790:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319613.217342:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319613.284473:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319613.985014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319613.985028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319613.985031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319613.985035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319613.985039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319613.985051:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4513 00000100:00080000:3.0:1767319613.985065:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319613.985073:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319613.985089:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319613.985153:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291927040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319613.985163:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319588/real 1767319588] req@ffff8c3c58fc3b80 x1853164291925632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319613 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319613.985228:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3b80 x1853164291925632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319613 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319613.985257:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319613.985293:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319613.985325:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291927168:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319613.985391:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319613.985500:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319613.985507:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291925632:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319613.987324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319613.987334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319613.987337:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319613.987346:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4493 00000100:00080000:0.0:1767319613.987357:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319613.987363:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319613.987401:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291927296/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319613.987807:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291927296:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319613.988050:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319613.988056:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319613.988061:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319613.994254:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291927168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319614.241036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319614.305142:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319615.265157:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319615.329510:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319616.289008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319616.353305:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319617.313288:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319617.377647:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319618.337053:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319618.403460:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319619.106133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319619.106146:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319619.106150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319619.106154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319619.106159:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319619.106168:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4518 00000100:00080000:3.0:1767319619.106179:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319619.106187:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319619.106201:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319619.106554:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291927424/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319619.106677:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319619.106983:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291927552:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319619.117614:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319619.117632:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319619.117639:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319619.117934:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291927552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319619.361800:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319619.425225:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319620.387392:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319620.449221:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319621.409247:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319621.473640:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319622.117265:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319622.117286:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319622.117290:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319622.117293:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319622.117298:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319622.117308:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4523 00000100:00080000:2.0:1767319622.117340:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319622.117347:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319622.117360:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319622.117391:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291927680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319622.117594:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291927808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319622.123648:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927680:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319622.127908:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319622.127932:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319622.127936:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319622.128022:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291927808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319622.433002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319622.497659:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319623.457143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319623.521108:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319624.481389:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319624.546343:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319625.505258:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319625.569300:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319626.529265:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319626.593326:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319627.297466:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319627.297476:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319627.297480:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319627.297483:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319627.297488:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319627.297497:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4527 00000100:00080000:2.0:1767319627.297508:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319627.297515:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319627.297527:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319627.297564:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291927936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319627.297691:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319627.299817:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291928064:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319627.319317:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319627.319332:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319627.319338:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291927936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319627.323191:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291928064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319627.553041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319627.618404:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319628.577117:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319628.647292:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319629.601084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319629.665514:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319630.625010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319630.689213:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319631.649219:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319631.713214:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319632.417361:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319632.417377:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319632.417381:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319632.417386:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319632.417391:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319632.417429:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4532 00000100:00080000:0.0:1767319632.417443:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319632.417452:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319632.417468:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319632.417525:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291928192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319632.417666:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319632.417690:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291928320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319632.421472:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928192:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319632.428489:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319632.428513:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319632.428520:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319632.428727:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291928320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319632.673696:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319632.737263:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319633.697040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319633.761858:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319634.723127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319634.785026:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319635.745535:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319635.809588:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319636.769238:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319636.834486:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319637.539344:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319637.539356:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319637.539359:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319637.539363:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319637.539368:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319637.539379:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4537 00000100:00080000:1.0:1767319637.539394:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319637.539404:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319637.539417:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319637.539456:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291928448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319637.539542:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319637.540361:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319637.540517:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291928576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319637.544967:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319637.544974:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291928576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319637.544978:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319637.544981:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319637.793023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319637.857239:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319638.561019:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319613/real 1767319613] req@ffff8c3c50e9fb80 x1853164291927296/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319638.561056:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9fb80 x1853164291927296/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319638 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319638.561087:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319638.561120:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767319638.561124:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291927296:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319638.561268:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319638.561274:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319638.561277:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319638.561282:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4518 00000100:00080000:1.0:1767319638.561291:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319638.561297:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319638.561327:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291928704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319638.561375:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319638.561379:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319638.561381:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319638.561385:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4542 00000100:00080000:1.0:1767319638.561389:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319638.561393:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319638.561402:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319638.561414:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291928832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319638.562026:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291928960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319638.562216:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291928704:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767319638.562250:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928832:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319638.575107:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319638.575123:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319638.575128:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291928832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319638.575230:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291928960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319638.817049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319638.881206:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319639.842204:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319639.905184:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319640.865026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319640.929199:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319641.889005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319641.953526:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319642.913109:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319642.977530:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319643.681263:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319643.681274:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319643.681277:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319643.681280:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319643.681283:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319643.681291:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4543 00000100:00080000:0.0:1767319643.681300:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319643.681307:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319643.681325:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319643.681356:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291929088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319643.681419:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319643.681446:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319643.694298:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319643.694635:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319643.694641:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319643.694643:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319643.937508:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319644.001107:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319644.961001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319645.025090:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319645.985006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319646.050686:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319647.010160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319647.073183:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319648.032978:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319648.097144:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319648.801092:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319648.801101:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319648.801104:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319648.801108:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319648.801111:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319648.801123:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4548 00000100:00080000:1.0:1767319648.801133:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319648.801140:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319648.801153:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319648.801186:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291929344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319648.801245:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291929472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319648.801345:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319648.807224:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319648.807240:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319648.807245:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319648.807371:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291929472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319649.057122:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319649.121134:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319650.081034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319650.148268:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319651.104992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319651.174012:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319652.130179:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319652.193129:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319653.154285:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319653.217518:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319653.921563:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319653.921574:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319653.921577:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319653.921601:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319653.921605:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319653.921617:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4553 00000100:00080000:1.0:1767319653.921629:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319653.921637:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319653.921648:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319653.921680:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291929600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319653.921773:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319653.921821:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319653.927420:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319653.927435:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319653.927437:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319653.927442:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319654.177070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319654.241610:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319655.201042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319655.265697:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319656.225013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319656.289966:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319657.249262:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319657.313199:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319658.273031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319658.337135:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319659.041718:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319659.041730:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319659.041733:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319659.041736:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319659.041741:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319659.041751:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4558 00000100:00080000:0.0:1767319659.041762:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319659.041768:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319659.041780:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319659.041816:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291929856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319659.041935:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319659.041959:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319659.041981:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319659.052668:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291929984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319659.052847:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319659.052854:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319659.052858:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291929856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319659.297387:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319659.361901:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319660.323939:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319660.385724:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319661.345098:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319661.409471:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319662.369486:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319662.434714:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319663.137078:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319638/real 1767319638] req@ffff8c3c46ab0700 x1853164291928704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319663 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319663.137128:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0700 x1853164291928704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319663 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319663.137153:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319663.137167:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319663.137174:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291928704:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319663.137634:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319663.137642:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319663.137647:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319663.137656:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4543 00000100:00080000:0.0:1767319663.137670:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319663.137680:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319663.137720:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291930112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319663.137758:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319663.137762:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319663.137764:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319663.137768:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4563 00000100:00080000:0.0:1767319663.137772:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319663.137776:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319663.137787:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319663.137799:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291930240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319663.137866:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319663.137920:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291930368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319663.137961:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291930112:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319663.138160:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319663.155997:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291930368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319663.156104:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319663.156112:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319663.156117:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319663.393917:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319663.457352:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319664.417028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319664.482045:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319665.441087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319665.505250:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319666.465046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319666.529103:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319667.490048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319667.553120:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319668.257137:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319668.257151:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319668.257179:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319668.257183:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319668.257189:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319668.257202:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4568 00000100:00080000:0.0:1767319668.257217:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319668.257225:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319668.257247:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319668.257288:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291930496/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319668.257385:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319668.257407:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291930624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319668.258255:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319668.262811:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291930624:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319668.264463:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319668.264549:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319668.264556:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319668.513157:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319668.577175:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319669.537047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319669.601198:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319670.562180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319670.626841:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319671.585060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319671.649132:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319672.609127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319672.673054:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319673.377158:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319673.377172:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319673.377175:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319673.377180:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319673.377185:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319673.377199:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4573 00000100:00080000:2.0:1767319673.377214:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319673.377223:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319673.377238:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319673.377282:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291930752/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319673.377423:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291930880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319673.377586:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930752:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319673.385348:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319673.385371:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319673.385378:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291930752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319673.385678:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291930880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319673.633753:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319673.697671:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319674.657212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319674.724030:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319675.681262:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319675.746449:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319676.705784:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319676.769221:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319677.729051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319677.795057:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319678.497358:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319678.497379:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319678.497385:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319678.497389:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319678.497398:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319678.497416:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4578 00000100:00080000:3.0:1767319678.497439:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319678.497451:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319678.497475:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319678.497542:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291931008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319678.497647:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291931136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319678.497860:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931008:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319678.502849:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767319678.502862:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291931136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319678.502868:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319678.502913:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319678.753056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319678.817521:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319679.780250:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319679.854124:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319680.800997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319680.866314:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319681.828574:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319681.889619:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319682.849072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319682.913108:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319683.621033:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319683.621049:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319683.621053:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319683.621058:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319683.621089:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319683.621103:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4583 00000100:00080000:3.0:1767319683.621117:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319683.621125:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319683.621142:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319683.621187:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291931264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319683.621231:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319683.621293:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319683.621315:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291931392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319683.630838:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319683.630855:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319683.630861:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319683.631283:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291931392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319683.874404:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319683.942282:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319684.897472:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319684.963575:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319685.921796:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319685.985186:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319686.945182:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319687.009181:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319687.969177:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319688.033967:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319688.738894:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319663/real 1767319663] req@ffff8c3c50e9c000 x1853164291930112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319688.738933:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c000 x1853164291930112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319688.738953:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319688.738962:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319688.738967:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291930112:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319688.739063:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319688.739068:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319688.739071:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319688.739077:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4568 00000100:00080000:0.0:1767319688.739086:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319688.739093:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319688.739127:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291931520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319688.739154:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319688.739157:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319688.739159:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319688.739177:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4588 00000100:00080000:0.0:1767319688.739182:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319688.739185:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319688.739195:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319688.739206:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291931648/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319688.739324:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291931776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319688.739817:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291931520:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319688.739902:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319688.742687:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291931776:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319688.745159:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319688.745188:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319688.745193:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319688.993776:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319689.057115:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319690.017177:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319690.084890:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319691.044075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319691.105310:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319692.065004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319692.129282:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319693.088989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319693.155705:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319693.856993:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319693.857004:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319693.857007:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319693.857011:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319693.857015:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319693.857024:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4593 00000100:00080000:3.0:1767319693.857035:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319693.857042:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319693.857062:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319693.857298:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291931904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319693.857385:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319693.857449:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319693.857464:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291932032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319693.862960:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319693.862976:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319693.862982:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291931904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319693.872216:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291932032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319694.114215:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319694.177079:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319695.137887:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319695.201095:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319696.161014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319696.225075:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319697.184987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319697.249114:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319698.209014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319698.275766:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319698.984028:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319698.984043:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319698.984046:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319698.984050:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319698.984056:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319698.984070:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4598 00000100:00080000:0.0:1767319698.984085:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319698.984095:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319698.984111:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319698.984160:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291932160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319698.984276:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291932288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319698.984566:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319698.995837:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291932288:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319699.000162:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319699.000183:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319699.000190:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319699.234315:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319699.297618:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319700.257900:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319700.322154:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319701.281208:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319701.345901:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319702.305952:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319702.369194:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319703.329047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319703.393265:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319704.097136:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319704.097152:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319704.097155:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319704.097161:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319704.097167:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319704.097181:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4603 00000100:00080000:1.0:1767319704.097196:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319704.097205:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319704.097219:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319704.097267:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291932416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319704.097422:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319704.097430:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291932544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319704.108052:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319704.108074:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319704.108081:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319704.115089:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291932544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319704.356800:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319704.417126:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319705.377484:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319705.441794:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319706.401649:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319706.465208:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319707.425483:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319707.489512:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319708.449119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319708.513349:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319709.217028:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319709.217041:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319709.217045:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319709.217049:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319709.217054:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319709.217068:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4608 00000100:00080000:1.0:1767319709.217082:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319709.217091:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319709.217107:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319709.217167:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291932672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319709.218014:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291932800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319709.218813:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319709.226492:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291932800:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319709.228986:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319709.229006:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319709.229012:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291932672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319709.473075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319709.537827:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319710.497116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319710.561215:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319711.521339:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319711.587538:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319712.545048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319712.610804:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319713.314405:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319688/real 1767319688] req@ffff8c3c50e9e680 x1853164291931520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319713.314443:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9e680 x1853164291931520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319713.314467:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319713.314489:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319713.314494:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291931520:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319713.314962:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319713.314969:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319713.314973:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319713.314980:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4593 00000100:00080000:0.0:1767319713.314993:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319713.315000:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767319713.315036:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291932928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319713.315065:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319713.315068:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319713.315069:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319713.315073:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4614 00000100:00080000:0.0:1767319713.315077:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319713.315081:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319713.315092:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319713.315105:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291933056/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319713.315158:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291933184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319713.315334:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291932928:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319713.315380:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319713.321813:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291933184:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319713.322024:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319713.322033:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319713.322037:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319713.569345:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319713.633230:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319714.593613:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319714.657267:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319715.617140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319715.681737:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319716.641160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319716.706038:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319717.665108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319717.729327:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319718.433410:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319718.433425:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319718.433452:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319718.433457:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319718.433462:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319718.433476:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4618 00000100:00080000:1.0:1767319718.433490:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319718.433499:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319718.433513:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319718.433556:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291933312/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319718.433805:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291933440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319718.434423:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933312:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319718.439133:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319718.439155:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319718.439192:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319718.439797:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291933440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319718.690224:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319718.753243:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319719.720629:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319719.777109:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319720.737999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319720.801975:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319721.765308:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319721.825655:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319722.785816:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319722.849177:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319723.562790:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319723.562801:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319723.562804:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319723.562807:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319723.562811:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319723.562822:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4623 00000100:00080000:3.0:1767319723.562833:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319723.562840:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319723.562853:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319723.562909:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291933568/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319723.562990:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319723.563006:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291933696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319723.563584:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933568:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319723.565935:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319723.565948:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319723.565953:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319723.566125:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291933696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319723.809005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319723.873158:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319724.833051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319724.897282:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319725.857003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319725.921919:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319726.880999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319726.945104:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319727.905065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319727.969360:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319728.673090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319728.673100:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319728.673104:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319728.673107:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319728.673318:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319728.673327:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4628 00000100:00080000:0.0:1767319728.673337:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319728.673344:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319728.673354:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319728.673386:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291933824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319728.673460:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291933952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319728.674332:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319728.678948:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291933952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319728.678950:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319728.678974:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319728.678983:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291933824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319728.929050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319728.994049:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319729.954618:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319730.021647:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319730.977040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319731.041453:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319732.001010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319732.065252:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319733.025400:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319733.089119:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319733.793005:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319733.793015:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319733.793018:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319733.793022:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319733.793026:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319733.793036:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4633 00000100:00080000:0.0:1767319733.793047:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319733.793071:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319733.793081:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319733.793109:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291934080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319733.793192:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319733.793218:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291934208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319733.793636:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319733.797354:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291934208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319733.797676:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319733.797683:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319733.797687:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319734.049085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319734.113131:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319735.073006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319735.139517:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319736.096998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319736.161672:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319737.121011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319737.185097:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319738.145038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319738.209152:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319738.913035:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319713/real 1767319713] req@ffff8c3c50e9ce00 x1853164291932928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319738.913079:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ce00 x1853164291932928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319738.913098:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319738.913128:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319738.913132:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291932928:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319738.913618:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319738.913625:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319738.913628:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319738.913633:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4618 00000100:00080000:3.0:1767319738.913643:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319738.913649:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319738.913682:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291934336/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319738.913711:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319738.913715:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319738.913716:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319738.913719:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4638 00000100:00080000:3.0:1767319738.913723:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319738.913727:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319738.913736:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319738.913748:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291934464/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319738.913931:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291934336:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319738.914034:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934464:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319738.915497:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291934592:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319738.935858:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291934592:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319738.939965:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319738.939981:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319738.939987:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934464:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319739.169136:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319739.233193:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319740.193025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319740.257251:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319741.217020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319741.281103:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319742.242680:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319742.305280:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319743.265003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319743.332569:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319744.033181:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319744.033191:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319744.033194:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319744.033198:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319744.033202:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319744.033212:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4643 00000100:00080000:3.0:1767319744.033224:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319744.033231:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319744.033242:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319744.033274:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291934720/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319744.033477:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291934848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319744.034219:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319744.038580:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291934848:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319744.050048:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319744.050064:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319744.050070:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319744.289000:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319744.353015:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319745.312990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319745.377309:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319746.337006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319746.401388:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319747.361394:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319747.425106:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319748.385532:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319748.449289:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319749.156103:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319749.156119:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319749.156122:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319749.156127:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319749.156133:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319749.156146:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4648 00000100:00080000:0.0:1767319749.156162:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319749.156172:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319749.156188:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319749.156234:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291934976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319749.156477:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291935104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319749.157439:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934976:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319749.166331:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319749.166350:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319749.166355:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291934976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319749.166468:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291935104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319749.409005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319749.474448:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319750.433025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319750.497600:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319751.457326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319751.521094:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319752.480993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319752.545061:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319753.505119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319753.569470:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319754.273488:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319754.273515:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319754.273518:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319754.273521:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319754.273526:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319754.273536:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4654 00000100:00080000:0.0:1767319754.273546:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319754.273552:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319754.273563:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319754.273592:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291935232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319754.273689:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291935360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319754.275080:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319754.285708:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291935360:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319754.293919:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319754.293940:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319754.293947:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319754.531201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319754.595959:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319755.553130:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319755.617266:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319756.577104:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319756.641747:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319757.601951:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319757.665411:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319758.625168:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319758.691574:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319759.395770:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319759.395790:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319759.395794:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319759.395799:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319759.395806:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319759.395823:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4659 00000100:00080000:0.0:1767319759.395839:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319759.395848:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319759.395865:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319759.395931:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291935488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319759.396050:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319759.397055:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291935616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319759.413615:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319759.413639:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319759.413646:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319759.419991:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291935616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319759.649069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319759.713316:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319760.673049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319760.737311:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319761.699019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319761.762404:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319762.721270:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319762.785095:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319763.489081:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319738/real 1767319738] req@ffff8c3c58fc0380 x1853164291934336/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319763.489126:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0380 x1853164291934336/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319763.489183:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319763.489217:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319763.489223:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291934336:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319763.489346:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319763.489353:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319763.489357:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319763.489363:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4643 00000100:00080000:3.0:1767319763.489374:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319763.489382:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319763.489420:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291935744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319763.489447:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319763.489451:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319763.489452:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319763.489456:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4664 00000100:00080000:3.0:1767319763.489459:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319763.489463:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319763.489474:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319763.489484:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291935872/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319763.489553:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319763.489568:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291936000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319763.490026:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291935744:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319763.490076:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935872:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319763.497229:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319763.497262:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319763.497268:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291935872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319763.497492:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291936000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319763.745073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319763.809431:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319764.769059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319764.838116:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319765.793281:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319765.857793:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319766.820460:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319766.896290:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319767.841041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319767.906073:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319768.609019:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319768.609033:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319768.609036:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319768.609041:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319768.609046:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319768.609060:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4668 00000100:00080000:3.0:1767319768.609075:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319768.609084:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319768.609099:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319768.609144:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291936128/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319768.609255:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319768.609311:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319768.609324:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291936256:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319768.616087:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319768.616110:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319768.616116:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319768.620012:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291936256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319768.865128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319768.929172:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319769.889252:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319769.953178:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319770.914151:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319770.978175:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319771.938931:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319772.001102:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319772.963535:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319773.025982:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319773.729919:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319773.729934:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319773.729938:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319773.729943:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319773.729948:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319773.729962:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4673 00000100:00080000:3.0:1767319773.729978:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319773.729990:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319773.730004:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319773.730090:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291936384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319773.730171:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319773.730194:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291936512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319773.730754:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319773.749499:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291936512:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319773.750362:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319773.750373:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319773.750378:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319773.985014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319774.049596:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319775.009309:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319775.074657:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319776.033926:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319776.098087:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319777.057143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319777.121212:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319778.082854:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319778.145159:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319778.849026:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319778.849040:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319778.849043:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319778.849047:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319778.849052:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319778.849067:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4678 00000100:00080000:3.0:1767319778.849081:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319778.849091:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319778.849106:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319778.849550:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291936640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319778.849660:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319778.849683:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291936768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319778.853298:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291936768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319778.853701:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936640:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319778.868604:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319778.868624:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319778.868630:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319779.105997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319779.169019:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319780.129024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319780.193273:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319781.153192:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319781.218324:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319782.177952:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319782.244822:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319783.201193:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319783.265247:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319783.971060:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319783.971103:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319783.971106:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319783.971111:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319783.971116:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319783.971130:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4683 00000100:00080000:3.0:1767319783.971147:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319783.971156:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319783.971171:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319783.971217:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291936896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319783.971492:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291937024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319783.973018:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936896:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319783.984862:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319783.984936:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319783.984944:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291936896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319783.984962:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291937024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319784.225005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319784.289762:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319785.249065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319785.315593:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319786.273268:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319786.337826:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319787.297130:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319787.363044:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319788.065064:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319763/real 1767319763] req@ffff8c3c58fc0000 x1853164291935744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319788 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319788.065115:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0000 x1853164291935744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319788 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319788.065141:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319788.065235:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319788.065265:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291935744:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319788.068015:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319788.068031:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319788.068038:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319788.068051:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4668 00000100:00080000:2.0:1767319788.068070:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319788.068082:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767319788.068145:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291937152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319788.068246:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291937152:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767319788.068406:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319788.068433:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319788.068437:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319788.068441:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4688 00000100:00080000:2.0:1767319788.068446:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319788.068452:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319788.068464:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319788.068479:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291937280/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319788.072426:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319788.072798:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291937408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319788.091411:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291937408:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319788.093167:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319788.093183:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319788.093189:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319788.321045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319788.385152:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319789.345095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319789.409162:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319790.370902:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319790.433104:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319791.393071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319791.459102:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319792.417054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319792.483517:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319793.186311:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319793.186325:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319793.186328:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319793.186333:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319793.186338:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319793.186351:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4692 00000100:00080000:0.0:1767319793.186365:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319793.186373:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319793.186411:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319793.186450:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291937536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319793.186607:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291937664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319793.186797:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319793.190065:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291937664:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319793.191349:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319793.191364:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319793.191370:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319793.441258:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319793.506061:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319794.465052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319794.530388:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319795.489183:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319795.559783:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319796.513011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319796.577193:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319797.537415:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319797.601463:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319798.308927:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319798.308941:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319798.308945:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319798.308949:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319798.308955:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319798.308969:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4698 00000100:00080000:0.0:1767319798.308984:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319798.308992:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319798.309006:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319798.309054:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291937792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319798.309210:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319798.309382:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291937920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319798.318354:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319798.318376:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319798.318382:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291937792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319798.318497:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291937920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319798.561174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319798.625254:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319799.586351:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319799.649147:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319800.609048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319800.673980:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319801.633088:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319801.699389:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319802.657303:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319802.722929:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319803.425351:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319803.425366:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319803.425370:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319803.425373:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319803.425378:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319803.425388:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4703 00000100:00080000:3.0:1767319803.425399:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319803.425405:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319803.425417:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319803.425463:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291938048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319803.425541:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319803.425783:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291938176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319803.431711:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291938176:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319803.433587:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319803.433606:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319803.433612:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319803.680997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319803.746243:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319804.705110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319804.769072:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319805.729080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319805.793191:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319806.753337:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319806.817201:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319807.782159:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319807.841760:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319808.547591:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319808.547607:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319808.547635:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319808.547640:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319808.547646:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319808.547660:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4708 00000100:00080000:1.0:1767319808.547675:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319808.547684:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319808.547699:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319808.547758:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291938304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319808.547861:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291938432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319808.548104:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319808.553964:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319808.554004:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319808.554011:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319808.554168:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291938432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319808.801048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319808.865239:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319809.825076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319809.893176:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319810.849158:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319810.913462:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319811.873051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319811.940788:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319812.899819:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319812.968220:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319813.665172:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319813.665183:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319813.665186:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319813.665191:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319813.665197:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319813.665211:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4713 00000100:00080000:1.0:1767319813.665247:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319813.665258:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319813.665273:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319813.665312:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291938560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319813.665382:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319813.665405:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291938688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319813.665935:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319788/real 1767319788] req@ffff8c3c5a28ad80 x1853164291937152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319813.665963:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28ad80 x1853164291937152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319813.665977:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938560:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319813.666018:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319813.666032:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319813.666036:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291937152:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319813.666514:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319813.666521:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319813.666525:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319813.666532:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4692 00000100:00080000:1.0:1767319813.666539:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319813.666544:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319813.666568:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291938816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319813.666650:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291938816:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767319813.678538:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319813.678560:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319813.678566:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319813.678646:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291938688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319813.921194:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319813.985570:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319814.945223:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319815.009608:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319815.969354:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319816.033106:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319816.993379:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319817.057961:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319818.016959:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319818.081035:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319818.785266:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319818.785280:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319818.785283:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319818.785287:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319818.785292:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319818.785305:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4718 00000100:00080000:3.0:1767319818.785319:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319818.785329:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319818.785342:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319818.785388:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291938944/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319818.785475:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319818.786917:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291939072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319818.798888:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291939072:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319818.799427:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319818.799465:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319818.799470:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291938944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319819.041073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319819.105189:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319820.065341:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319820.129399:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319821.089307:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319821.153385:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319822.113039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319822.177254:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319823.137630:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319823.201473:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319823.910415:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319823.910426:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319823.910429:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319823.910433:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319823.910437:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319823.910446:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4723 00000100:00080000:1.0:1767319823.910458:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319823.910466:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319823.910478:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319823.910512:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291939200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319823.910617:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291939328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319823.910972:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939200:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319823.930410:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319823.930438:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319823.930443:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319823.932008:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291939328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319824.161078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319824.225131:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319825.185041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319825.249002:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319826.209583:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319826.273265:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319827.243033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319827.298569:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319828.257224:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319828.321297:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319829.025926:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319829.025940:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319829.025943:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319829.025974:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319829.026499:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319829.026516:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4728 00000100:00080000:3.0:1767319829.026529:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319829.026538:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319829.026555:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319829.026598:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291939456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319829.026696:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319829.026718:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291939584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319829.028194:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319829.047298:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291939584:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319829.048964:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319829.048981:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319829.048987:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319829.282990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319829.345257:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319830.305034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319830.369385:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319831.329011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319831.395671:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319832.353029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319832.417143:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319833.377012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319833.441675:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319834.146163:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319834.146174:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319834.146185:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319834.146189:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319834.146193:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319834.146203:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4733 00000100:00080000:1.0:1767319834.146218:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319834.146225:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319834.146237:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319834.146269:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291939712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319834.146354:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319834.146371:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291939840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319834.147862:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319834.150528:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291939840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319834.152815:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319834.152835:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319834.152841:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291939712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319834.401220:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319834.465394:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319835.425025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319835.489149:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319836.449001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319836.515059:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319837.473004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319837.537074:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319838.244401:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319813/real 1767319813] req@ffff8c3c46ab0a80 x1853164291938816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319838.244437:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0a80 x1853164291938816/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319838.244457:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319838.244488:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319838.244493:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291938816:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319838.244567:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319838.244573:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319838.244576:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319838.244582:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4718 00000100:00080000:3.0:1767319838.244592:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319838.244599:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319838.244630:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291939968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319838.244660:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319838.244664:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319838.244665:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319838.244669:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4739 00000100:00080000:3.0:1767319838.244688:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319838.244692:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319838.244702:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319838.244714:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291940096/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319838.244820:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291939968:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319838.244943:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319838.245043:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319838.245054:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291940224:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319838.253123:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319838.253153:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319838.253159:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319838.263014:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291940224:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319838.499197:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319838.561113:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319839.523072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319839.585593:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319840.545046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319840.609201:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319841.575800:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319841.633178:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319842.595735:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319842.657163:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319843.362136:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319843.362146:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319843.362148:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319843.362152:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319843.362157:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319843.362166:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4743 00000100:00080000:2.0:1767319843.362177:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319843.362183:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319843.362222:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319843.362254:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291940352/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319843.362344:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319843.362361:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291940480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319843.362766:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940352:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319843.364768:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319843.364788:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319843.364825:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319843.364844:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291940480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319843.619081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319843.681023:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319844.640992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319844.706455:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319845.666149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319845.733806:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319846.689092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319846.755840:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319847.713041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319847.777090:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319848.484571:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319848.484585:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319848.484588:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319848.484593:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319848.484598:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319848.484611:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4748 00000100:00080000:0.0:1767319848.484626:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319848.484634:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319848.484648:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319848.484691:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291940608/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319848.484779:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319848.484800:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291940736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319848.484984:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940608:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319848.491633:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319848.491655:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319848.491661:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319848.501095:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291940736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319848.740786:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319848.801259:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319849.762847:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319849.825246:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319850.787518:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319850.849953:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319851.809044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319851.873196:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319852.833038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319852.897064:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319853.601231:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319853.601242:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319853.601245:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319853.601249:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319853.601253:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319853.601277:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4753 00000100:00080000:1.0:1767319853.601301:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319853.601511:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319853.601523:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319853.601558:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291940864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319853.601649:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291940992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319853.602122:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319853.609942:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291940992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319853.610152:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319853.610160:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319853.610172:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291940864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319853.858013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319853.921176:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319854.881360:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319854.945042:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319855.904994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319855.969353:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319856.935267:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319856.993489:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319857.953184:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319858.017122:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319858.721316:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319858.721327:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319858.721330:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319858.721334:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319858.721339:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319858.721350:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4758 00000100:00080000:0.0:1767319858.721361:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319858.721369:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319858.721382:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319858.721418:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291941120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319858.721493:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291941248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319858.722723:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941120:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319858.728137:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319858.728152:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319858.728157:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319858.728584:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291941248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319858.977009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319859.045320:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319860.000989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319860.066102:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319861.025009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319861.096924:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319862.049014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319862.113213:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319863.073642:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319863.137118:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319863.841320:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319863.841330:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319863.841334:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319863.841337:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319863.841342:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319863.841353:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4763 00000100:00080000:1.0:1767319863.841363:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319863.841370:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319863.841380:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319863.841412:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291941376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319863.841486:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291941504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319863.841903:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319838/real 1767319838] req@ffff8c3c58fc2d80 x1853164291939968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319863.841925:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2d80 x1853164291939968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319863.841951:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941376:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319863.841986:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319863.842030:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319863.842035:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291939968:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319863.842374:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319863.842378:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319863.842388:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319863.842393:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4743 00000100:00080000:1.0:1767319863.842397:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319863.842402:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319863.842420:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291941632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319863.842716:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291941632:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319863.855674:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291941504:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319863.855785:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319863.855790:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319863.855794:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319864.099155:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319864.161549:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319865.121108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319865.185294:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319866.145064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319866.212020:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319867.170212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319867.233100:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319868.193025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319868.257508:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319868.960994:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319868.961004:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319868.961008:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319868.961011:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319868.961016:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319868.961026:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4768 00000100:00080000:3.0:1767319868.961037:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319868.961044:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319868.961055:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319868.961088:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291941760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319868.961155:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319868.961167:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319868.961179:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291941888:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319868.970312:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319868.970328:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319868.970333:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291941760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319868.970519:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291941888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319869.217005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319869.281278:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319870.241019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319870.305680:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319871.265070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319871.329342:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319872.289276:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319872.353215:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319873.313224:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319873.378085:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319874.081548:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319874.081563:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319874.081566:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319874.081571:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319874.081576:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319874.081589:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4773 00000100:00080000:0.0:1767319874.081603:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319874.081612:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319874.081627:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319874.081674:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291942016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319874.081760:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291942144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319874.083165:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942016:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319874.090350:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319874.090373:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319874.090401:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319874.090580:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291942144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319874.338239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319874.401981:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319875.362319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319875.429498:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319876.388687:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319876.450711:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319877.409035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319877.474522:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319878.433121:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319878.498588:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319879.201590:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319879.201603:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319879.201606:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319879.201610:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319879.201616:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319879.201629:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4778 00000100:00080000:1.0:1767319879.201644:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319879.201654:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319879.201670:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319879.201717:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291942272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319879.201791:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319879.201815:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291942400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319879.201929:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942272:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319879.215388:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319879.215409:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319879.215416:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319879.216210:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291942400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319879.458694:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319879.521680:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319880.481659:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319880.545109:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319881.505035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319881.569356:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319882.529822:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319882.594389:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319883.552971:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319883.625153:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319884.321060:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319884.321077:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319884.321081:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319884.321085:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319884.321091:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319884.321104:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4784 00000100:00080000:1.0:1767319884.321119:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319884.321128:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319884.321143:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319884.321202:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291942528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319884.321315:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319884.321339:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291942656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319884.321775:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942528:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319884.327281:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319884.327314:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319884.327321:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319884.327672:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291942656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319884.580026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319884.641636:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319885.602543:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319885.665279:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319886.625071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319886.693806:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319887.649081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319887.713985:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319888.418942:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319863/real 1767319863] req@ffff8c3c46ab3480 x1853164291941632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319888 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319888.418989:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3480 x1853164291941632/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319888 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319888.419013:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319888.419050:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767319888.419055:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291941632:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319888.419156:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319888.419163:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319888.419167:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319888.419172:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4768 00000100:00080000:3.0:1767319888.419186:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319888.419194:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319888.419238:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291942784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319888.419298:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291942784:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319888.419447:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319888.419451:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319888.419453:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319888.419457:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4789 00000100:00080000:3.0:1767319888.419462:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319888.419466:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319888.419476:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319888.419497:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291942912/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319888.422978:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319888.423505:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319888.423518:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291943040:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319888.437374:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319888.437395:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319888.437401:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291942912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319888.438126:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291943040:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319888.673018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319888.739514:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319889.697005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319889.761168:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319890.721052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319890.785337:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319891.745476:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319891.809187:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319892.768997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319892.838552:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319893.540269:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319893.540280:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319893.540283:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319893.540286:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319893.540290:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319893.540299:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4793 00000100:00080000:0.0:1767319893.540311:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319893.540317:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319893.540328:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319893.540359:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291943168/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319893.540442:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319893.540457:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291943296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319893.540700:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943168:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319893.558990:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319893.559004:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319893.559009:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319893.560793:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291943296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319893.792993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319893.857941:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319894.817003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319894.881098:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319895.856360:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319895.905457:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319896.865148:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319896.929140:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319897.891749:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319897.954039:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319898.657036:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319898.657048:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319898.657050:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319898.657055:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319898.657059:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319898.657072:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4798 00000100:00080000:0.0:1767319898.657085:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319898.657095:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319898.657125:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319898.657156:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291943424/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319898.657279:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291943552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319898.657320:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943424:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319898.673909:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319898.673926:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319898.673932:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319898.675508:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291943552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319898.912999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319898.977032:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319899.937240:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319900.001329:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319900.961327:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319901.025750:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319901.985475:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319902.049239:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319903.011461:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319903.073316:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319903.778240:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319903.778253:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319903.778256:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319903.778261:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319903.778266:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319903.778280:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4803 00000100:00080000:2.0:1767319903.778294:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319903.778303:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319903.778349:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319903.778405:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291943680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319903.778719:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291943808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319903.779775:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943680:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767319903.797430:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319903.797452:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319903.797459:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319903.799042:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291943808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319904.033058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319904.099904:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319905.060063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319905.124661:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319906.081058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319906.147542:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319907.108436:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319907.169130:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319908.129143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319908.200310:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319908.898968:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319908.898984:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319908.898987:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319908.898992:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319908.898998:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319908.899011:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4808 00000100:00080000:2.0:1767319908.899028:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319908.899037:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319908.899053:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319908.899099:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291943936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319908.899372:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291944064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319908.901857:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319908.904262:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291944064:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767319908.918777:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319908.918800:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767319908.918806:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291943936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319909.153141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319909.219720:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319910.177453:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319910.241197:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319911.201059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319911.268225:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319912.225070:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319912.289199:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319913.249102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319913.313350:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319914.017812:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319888/real 1767319888] req@ffff8c3c58fc1180 x1853164291942784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319913 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319914.017853:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc1180 x1853164291942784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319913 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319914.017911:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319914.017922:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767319914.017927:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291942784:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319914.018206:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319914.018212:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319914.018216:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319914.018221:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4793 00000100:00080000:1.0:1767319914.018232:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319914.018241:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319914.018276:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164291944192/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319914.018304:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319914.018320:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319914.018323:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319914.018327:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4813 00000100:00080000:1.0:1767319914.018330:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319914.018334:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319914.018345:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319914.018358:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291944320/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319914.018423:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291944448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319914.018631:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291944192:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767319914.018758:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319914.021815:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291944448:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767319914.031848:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319914.031899:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319914.031926:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319914.273167:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319914.341913:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319915.297073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319915.361124:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319916.321043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319916.391244:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319917.345039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319917.409072:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319918.369034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319918.433820:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319919.137001:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319919.137016:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319919.137019:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319919.137023:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319919.137029:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319919.137043:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4818 00000100:00080000:1.0:1767319919.137057:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319919.137067:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319919.137081:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319919.137126:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291944576/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319919.140997:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944576:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319919.152706:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319919.152729:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767319919.152736:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319919.155815:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291944704:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319919.171779:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291944704:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319919.393041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319919.457336:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319920.417043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319920.481368:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319921.441046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319921.505313:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319922.465096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319922.529207:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319923.490026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319923.553182:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319924.257138:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319924.257152:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319924.257180:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319924.257186:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319924.257191:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319924.257204:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4824 00000100:00080000:0.0:1767319924.257220:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319924.257230:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319924.257245:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319924.257300:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291944832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319924.257378:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319924.257396:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291944960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767319924.261585:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291944960:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319924.265101:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319924.265122:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319924.265157:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291944832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319924.513049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319924.577343:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319925.537088:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319925.601449:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319926.561599:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319926.625751:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319927.586974:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319927.649179:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319928.608992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319928.673254:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319929.377549:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319929.377564:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319929.377567:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319929.377573:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319929.377585:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319929.377599:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4829 00000100:00080000:2.0:1767319929.377615:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319929.377626:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319929.377642:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319929.377690:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291945088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319929.377780:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291945216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319929.378564:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319929.401750:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291945216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319929.402101:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319929.402109:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319929.402114:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319929.635717:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319929.697854:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319930.657054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319930.721785:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319931.681959:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319931.745119:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319932.705468:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319932.769172:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319933.729350:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319933.794354:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319934.498321:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319934.498336:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319934.498340:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319934.498345:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319934.498351:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319934.498365:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4834 00000100:00080000:0.0:1767319934.498388:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319934.498397:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319934.498411:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319934.498456:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291945344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319934.498584:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291945472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319934.498653:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319934.506211:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319934.506233:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319934.506239:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319934.516568:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291945472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319934.755505:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319934.817447:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319935.778241:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319935.841433:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319936.801094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319936.866465:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319937.825075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319937.889141:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319938.849506:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319938.914141:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319939.617730:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319939.617743:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319939.617747:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319939.617751:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319939.617757:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319939.617771:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4839 00000100:00080000:1.0:1767319939.617785:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319939.617794:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319939.617809:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319939.617857:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291945600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319939.618088:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319914/real 1767319914] req@ffff8c3c46ab2d80 x1853164291944192/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319939 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319939.618114:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2d80 x1853164291944192/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319939 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319939.618134:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767319939.618251:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319939.618271:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767319939.618275:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291944192:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319939.618353:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319939.618357:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319939.618360:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319939.618365:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4818 00000100:00080000:1.0:1767319939.618369:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319939.618373:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319939.618388:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291945856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319939.618996:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291945728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767319939.619541:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291945856:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319939.622283:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319939.622313:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319939.622319:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319939.638816:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291945728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319939.873454:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319939.937514:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319940.897039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319940.962277:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319941.922095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319941.986653:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319942.945049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319943.009296:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319943.968993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319944.034539:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319944.738369:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319944.738384:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319944.738388:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319944.738392:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319944.738421:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319944.738434:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4844 00000100:00080000:2.0:1767319944.738449:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319944.738458:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319944.738474:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319944.738520:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291945984/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319944.739385:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319944.740995:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291946112:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319944.748857:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319944.748913:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319944.748922:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291945984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319944.748984:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291946112:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319944.993263:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319945.057622:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319946.018380:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319946.085338:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319947.041163:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319947.108434:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319948.065053:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319948.129182:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319949.089036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319949.153112:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319949.857066:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319949.857076:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319949.857079:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319949.857083:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319949.857087:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319949.857096:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4849 00000100:00080000:2.0:1767319949.857106:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319949.857113:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319949.857124:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319949.857161:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291946240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319949.857507:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319949.860180:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291946368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319949.860731:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319949.860740:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319949.860745:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319949.866028:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291946368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319950.114789:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319950.177629:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319951.137065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319951.204057:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319952.161112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319952.226734:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319953.185072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319953.249785:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319954.209213:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319954.273112:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319954.978432:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319954.978444:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319954.978447:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319954.978450:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319954.978454:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319954.978465:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4854 00000100:00080000:0.0:1767319954.978478:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767319954.978503:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319954.978515:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319954.978549:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291946496/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319954.978651:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291946624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319954.978946:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946496:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319954.986284:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319954.986302:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319954.986307:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319954.989673:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291946624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319955.233079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319955.297552:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319956.257020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319956.322532:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319957.281202:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319957.346326:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319958.054154:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291946752:192.168.202.133@tcp:17:kworker.0 00000100:00100000:3.0:1767319958.066350:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291946752:192.168.202.133@tcp:17:kworker.0 00000100:00100000:1.0:1767319958.305048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319958.369455:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319959.329038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319959.393557:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319960.097188:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319960.097200:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319960.097203:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319960.097208:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319960.097213:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319960.097224:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4859 00000100:00080000:2.0:1767319960.097237:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1767319960.097244:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767319960.097257:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319960.097294:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291946880/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319960.097644:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319960.097661:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291947008:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319960.097847:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319960.100974:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291947008:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319960.101245:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319960.101252:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319960.101257:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291946880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319960.353034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319960.417196:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319961.378774:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319961.441166:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319962.409510:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319962.466019:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319963.425075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319963.493469:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319964.193051:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319939/real 1767319939] req@ffff8c3c46ab1500 x1853164291945856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319964 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319964.193595:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab1500 x1853164291945856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319964 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319964.193665:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319964.193684:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767319964.193689:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291945856:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767319964.193992:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319964.193997:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319964.194000:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319964.194005:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4844 00000100:00080000:3.0:1767319964.194015:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319964.194021:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767319964.194049:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164291947136/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319964.194075:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319964.194079:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319964.194081:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319964.194085:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4864 00000100:00080000:3.0:1767319964.194089:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1767319964.194118:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319964.194128:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319964.194141:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2d80 x1853164291947264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319964.194220:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291947392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319964.194679:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291947136:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767319964.194732:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319964.230197:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291947392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319964.230297:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319964.230305:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319964.230309:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319964.449101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319964.513207:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319965.473127:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319965.545055:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319966.497914:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319966.563522:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319967.526258:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319967.585177:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319968.547182:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319968.609262:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319969.313014:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319969.313023:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319969.313026:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319969.313030:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319969.313034:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319969.313043:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4869 00000100:00080000:3.0:1767319969.313054:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319969.313073:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319969.313084:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319969.313119:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291947520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319969.313165:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319969.313378:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291947648:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319969.323158:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319969.323173:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319969.323178:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319969.323292:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291947648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319969.569431:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319969.633551:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319970.593561:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319970.657107:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319971.617089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319971.683680:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319972.641915:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319972.705845:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319973.665573:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319973.729326:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319974.434262:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319974.434276:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319974.434514:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319974.434518:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319974.434523:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319974.434536:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4874 00000100:00080000:0.0:1767319974.434551:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319974.434560:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767319974.434575:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319974.434624:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291947776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319974.435895:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291947904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319974.436357:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947776:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319974.449246:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319974.449261:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319974.449266:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291947776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767319974.455734:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291947904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319974.689044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319974.753429:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319975.713030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319975.777316:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319976.737524:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319976.801238:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319977.761233:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319977.825556:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319978.785031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319978.849809:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319979.557026:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319979.557038:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319979.557042:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319979.557046:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319979.557051:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319979.557085:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4879 00000100:00080000:3.0:1767319979.557097:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319979.557105:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319979.557117:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319979.557149:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3800 x1853164291948032/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319979.557511:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291948160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319979.557700:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948032:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767319979.563680:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319979.563702:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319979.563709:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948032:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319979.566903:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291948160:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319979.809039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319979.874367:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319980.833815:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319980.897258:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319981.857041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319981.921069:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319982.881071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319982.945222:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319983.904971:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319983.974510:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319984.673181:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319984.673195:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319984.673198:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319984.673202:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319984.673208:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319984.673222:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4884 00000100:00080000:3.0:1767319984.673235:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319984.673243:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319984.673257:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319984.673306:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291948288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319984.673380:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319984.674018:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319984.674032:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291948416:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767319984.691353:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319984.691377:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767319984.691384:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767319984.695607:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291948416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767319984.929025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319984.993100:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319985.953143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319986.017230:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319986.977082:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319987.042140:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319988.001041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319988.065185:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319989.025040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319989.089202:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319989.793079:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319989.793094:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319989.793099:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319989.793103:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319989.793109:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319989.793123:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4889 00000100:00080000:1.0:1767319989.793139:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319989.793148:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767319989.793164:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319989.793212:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291948544/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319989.793378:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291948672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319989.795119:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319964/real 1767319964] req@ffff8c3c58fc0a80 x1853164291947136/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319989 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319989.795154:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0a80 x1853164291947136/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319989 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319989.795178:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948544:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767319989.795292:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319989.795312:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767319989.795317:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291947136:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767319989.795398:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319989.795403:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319989.795407:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319989.795413:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4869 00000100:00080000:1.0:1767319989.795418:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319989.795425:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767319989.795451:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291948800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319989.795604:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291948800:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767319989.805091:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291948672:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319989.805220:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319989.805228:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319989.805232:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319990.049338:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319990.114423:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319991.073076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767319991.137406:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319992.097029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319992.165394:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319993.120990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319993.185163:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319994.145036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319994.209906:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319994.913132:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319994.913170:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319994.913173:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319994.913176:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319994.913181:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319994.913191:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4894 00000100:00080000:3.0:1767319994.913204:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319994.913211:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767319994.913223:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319994.913259:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291948928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319994.913343:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291949056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767319994.914644:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767319994.919047:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291949056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767319994.919264:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319994.919272:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767319994.919276:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291948928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767319995.169030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319995.234600:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319996.193684:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319996.257139:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319997.219668:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767319997.284728:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319998.241264:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767319998.306846:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319999.265013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767319999.329416:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320000.036552:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320000.036560:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320000.036564:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320000.036568:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320000.036572:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320000.036583:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4899 00000100:00080000:1.0:1767320000.036593:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320000.036601:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320000.036612:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320000.036645:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291949184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320000.036731:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291949312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320000.036906:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320000.041356:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291949312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320000.051173:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320000.051196:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320000.051202:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320000.289103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320000.353033:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320001.315278:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320001.377132:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320002.339325:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320002.403196:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320003.361034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320003.425086:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320004.385140:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320004.449211:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320005.153016:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320005.153027:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320005.153030:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320005.153033:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320005.153037:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320005.153046:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4904 00000100:00080000:1.0:1767320005.153056:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320005.153062:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320005.153074:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320005.153107:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291949440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320005.153256:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291949568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320005.154027:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949440:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320005.172178:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320005.172200:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320005.172211:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291949568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320005.172212:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320005.409036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320005.474053:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320006.433039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320006.498591:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320007.464450:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320007.522491:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320008.483951:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320008.553512:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320009.505010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320009.569585:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320010.273531:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320010.273543:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320010.273546:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320010.273550:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320010.273554:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320010.273564:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4910 00000100:00080000:2.0:1767320010.273575:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320010.273582:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320010.273593:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320010.273642:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291949696/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320010.273712:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320010.274074:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320010.274085:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291949824:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320010.280826:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291949824:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320010.301183:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320010.301198:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320010.301205:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291949696:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320010.529186:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320010.593760:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320011.553002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320011.619649:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320012.587606:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320012.641130:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320013.601547:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320013.666537:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320014.369105:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319989/real 1767319989] req@ffff8c3c46ab3800 x1853164291948800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320014 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320014.369171:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3800 x1853164291948800/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320014 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320014.369199:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320014.369308:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320014.369314:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291948800:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320014.372831:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320014.375501:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320014.375510:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320014.375522:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4894 00000100:00080000:3.0:1767320014.375534:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320014.375571:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320014.375699:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291949952/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320014.375779:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291949952:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320014.376371:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320014.376377:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320014.376392:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320014.376398:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4915 00000100:00080000:3.0:1767320014.376402:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320014.376406:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320014.376416:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320014.376430:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291950080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320014.376470:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320014.376789:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320014.400740:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320014.400756:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320014.400762:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320014.401158:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320014.625061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320014.689411:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320015.653808:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320015.713277:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320016.673707:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320016.738825:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320017.696995:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320017.765450:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320018.721916:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320018.785203:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320019.489453:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320019.489467:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320019.489471:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320019.489476:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320019.489481:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320019.489494:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4919 00000100:00080000:2.0:1767320019.489508:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320019.489518:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320019.489534:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320019.489580:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291950336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320019.489693:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320019.489720:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320019.489786:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950336:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320019.493843:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320019.493863:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320019.493899:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320019.496273:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320019.745043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320019.814927:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320020.769449:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320020.833115:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320021.793300:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320021.857153:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320022.821290:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320022.885003:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320023.841167:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320023.907727:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320024.610832:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320024.610846:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320024.610850:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320024.610855:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320024.610864:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320024.610927:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4924 00000100:00080000:1.0:1767320024.610943:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320024.610952:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320024.610969:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320024.611017:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291950592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320024.611100:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291950720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320024.611404:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950592:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320024.626634:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320024.626650:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320024.626655:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320024.627074:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291950720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320024.868605:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320024.930718:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320025.889025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320025.954767:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320026.913085:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320026.977950:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320027.937108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320028.001444:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320028.960959:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320029.026495:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320029.729088:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320029.729099:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320029.729102:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320029.729106:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320029.729110:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320029.729131:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4929 00000100:00080000:2.0:1767320029.729144:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320029.729151:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320029.729162:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320029.729200:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291950848/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320029.729549:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950976:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320029.730965:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320029.731505:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291950976:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320029.736539:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320029.736554:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320029.736559:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291950848:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320029.985166:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320030.051350:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320031.009078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320031.074969:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320032.033007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320032.102756:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320033.058841:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320033.121304:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320034.083576:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320034.145147:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320034.849518:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320034.849533:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320034.849536:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320034.849563:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320034.849567:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320034.849581:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4934 00000100:00080000:2.0:1767320034.849596:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320034.849627:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320034.849647:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320034.849690:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291951104/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320034.849798:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291951232:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320034.851420:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320034.861841:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291951232:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320034.869282:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320034.869305:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320034.869313:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951104:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320035.105921:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320035.169233:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320036.130619:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320036.193138:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320037.153007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320037.217095:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320038.177025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320038.241125:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320039.201110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320039.265145:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320039.969063:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320014/real 1767320014] req@ffff8c3c58fc3100 x1853164291949952/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320039 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320039.969110:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc3100 x1853164291949952/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320039 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320039.969137:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320039.969148:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320039.969153:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291949952:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320039.969403:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320039.969461:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320039.969464:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320039.969472:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4919 00000100:00080000:1.0:1767320039.969484:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320039.969492:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320039.969539:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291951360/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320039.969568:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320039.969572:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320039.969574:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320039.969578:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4939 00000100:00080000:1.0:1767320039.969582:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320039.969585:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320039.969597:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320039.969610:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291951488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320039.969689:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291951616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320039.969856:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291951360:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320039.969916:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951488:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320039.980221:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320039.980243:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320039.980250:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320039.981356:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291951616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320040.225698:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320040.291136:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320041.251774:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320041.313421:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320042.273021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320042.337079:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320043.297045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320043.362092:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320044.322937:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320044.385102:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320045.089084:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320045.089099:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320045.089102:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320045.089107:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320045.089112:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320045.089127:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4944 00000100:00080000:1.0:1767320045.089289:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320045.089303:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320045.089317:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320045.089515:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291951744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320045.089641:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320045.090263:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291951872:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320045.105559:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320045.105578:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320045.105584:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291951744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320045.112301:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291951872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320045.345697:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320045.409161:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320046.369456:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320046.433111:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320047.395212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320047.460380:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320048.417024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320048.484896:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320049.441245:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320049.505126:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320050.213687:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320050.213697:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320050.213700:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320050.213704:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320050.213709:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320050.213720:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4949 00000100:00080000:2.0:1767320050.213731:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320050.213739:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320050.213750:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320050.213784:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291952000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320050.215275:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291952128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320050.215603:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952000:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320050.219728:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320050.219742:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320050.219763:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320050.220238:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291952128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320050.465825:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320050.531941:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320051.489782:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320051.554530:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320052.512972:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320052.577122:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320053.537014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320053.601124:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320054.562914:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320054.625683:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320055.330207:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320055.330227:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320055.330230:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320055.330234:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320055.330239:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320055.330250:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4955 00000100:00080000:1.0:1767320055.330260:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320055.330267:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320055.330287:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320055.330317:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291952256/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320055.330530:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291952384:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320055.330691:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320055.341507:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291952384:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320055.343057:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320055.343069:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320055.343074:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952256:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320055.585773:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320055.649142:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320056.609517:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320056.673159:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320057.633028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320057.697701:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320058.657347:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320058.721224:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320059.681727:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320059.745062:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320060.449006:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320060.449020:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320060.449024:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320060.449029:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320060.449035:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320060.449046:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4960 00000100:00080000:0.0:1767320060.449059:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320060.449066:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320060.449078:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320060.449114:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291952512/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320060.449187:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291952640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320060.449243:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952512:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320060.461585:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320060.461602:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320060.461608:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952512:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320060.461794:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291952640:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320060.706506:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320060.769451:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320061.729080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320061.793750:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320062.753011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320062.817502:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320063.777032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320063.841233:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320064.546814:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320039/real 1767320039] req@ffff8c3c46ab2a00 x1853164291951360/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320064.546848:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2a00 x1853164291951360/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320064.546868:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320064.546917:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320064.546922:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291951360:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320064.546995:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320064.546999:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320064.547003:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320064.547024:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4944 00000100:00080000:0.0:1767320064.547032:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320064.547038:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320064.547065:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291952768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320064.547093:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320064.547097:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320064.547099:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320064.547103:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4965 00000100:00080000:0.0:1767320064.547107:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320064.547110:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320064.547118:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320064.547130:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291952896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320064.547170:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320064.547182:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320064.547373:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291952768:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320064.547412:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320064.552988:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953024:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320064.555490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320064.555503:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320064.555509:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291952896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320064.801518:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320064.865458:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320065.825004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320065.889305:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320066.849037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320066.914413:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320067.873008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320067.937532:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320068.899233:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320068.961393:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320069.665805:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320069.665816:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320069.665828:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320069.665832:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320069.665844:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320069.665854:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4969 00000100:00080000:1.0:1767320069.665864:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320069.665887:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320069.665899:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320069.665931:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291953152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320069.666030:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320069.666131:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320069.672082:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953280:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320069.673940:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320069.673952:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320069.673957:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320069.921055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320069.985600:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320070.945349:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320071.009198:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320071.969039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320072.036716:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320072.993046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320073.057166:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320074.018784:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320074.083988:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320074.785425:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320074.785457:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320074.785460:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320074.785463:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320074.785468:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320074.785481:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4974 00000100:00080000:0.0:1767320074.785494:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320074.785502:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320074.785516:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320074.785570:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291953408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320074.787076:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320074.787113:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320074.793743:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953408:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320074.797827:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320074.797848:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320074.797854:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320074.799248:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291953536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320075.041435:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320075.105441:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320076.065176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320076.129505:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320077.089032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320077.156377:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320078.113020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320078.178336:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320079.137351:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320079.204463:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320079.906262:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320079.906278:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320079.906282:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320079.906286:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320079.906292:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320079.906305:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4979 00000100:00080000:3.0:1767320079.906320:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320079.906329:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320079.906345:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320079.906393:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291953664/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320079.906485:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320079.906504:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291953792:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320079.908384:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320079.909126:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291953792:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320079.910721:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320079.910738:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320079.910744:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953664:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320080.161032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320080.225342:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320081.185020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320081.249156:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320082.211932:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320082.275843:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320083.233157:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320083.297045:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320084.257209:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320084.321494:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320085.027645:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320085.027659:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320085.027662:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320085.027666:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320085.027671:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320085.027707:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4984 00000100:00080000:1.0:1767320085.027721:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320085.027729:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320085.027745:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320085.027787:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291953920/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320085.027854:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320085.027902:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291954048:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320085.029285:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320085.032830:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291954048:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320085.032981:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320085.032990:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320085.032994:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291953920:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320085.282468:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320085.347612:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320086.305812:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320086.370304:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320087.332169:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320087.395785:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320088.353032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320088.417264:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320089.121086:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320064/real 1767320064] req@ffff8c3c50e9d880 x1853164291952768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320089 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320089.121132:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9d880 x1853164291952768/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320089 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320089.121156:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320089.121187:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320089.121193:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291952768:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320089.121236:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320089.121244:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320089.121248:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320089.121256:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4969 00000100:00080000:2.0:1767320089.121268:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320089.121276:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320089.121322:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291954176/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320089.121354:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320089.121358:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320089.121359:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320089.121364:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4989 00000100:00080000:2.0:1767320089.121368:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320089.121392:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320089.121404:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320089.121418:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291954304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320089.121481:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320089.121497:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291954432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320089.121689:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291954176:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320089.121728:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320089.128729:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320089.128749:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320089.128777:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320089.130347:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291954432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320089.377074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320089.441429:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320090.401174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320090.465431:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320091.425151:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320091.489498:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320092.449056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320092.513088:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320093.473029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320093.537137:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320094.241183:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320094.241193:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320094.241195:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320094.241198:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320094.241203:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320094.241214:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4994 00000100:00080000:3.0:1767320094.241236:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320094.241245:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320094.241294:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320094.241332:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291954560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320094.241425:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320094.241443:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291954688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320094.241746:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954560:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320094.254748:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320094.254769:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320094.254775:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320094.255349:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291954688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320094.497041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320094.561072:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320095.521006:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320095.586401:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320096.545152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320096.610774:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320097.569116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320097.639610:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320098.593029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320098.658956:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320099.361042:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320099.361053:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320099.361055:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320099.361059:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320099.361064:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320099.361074:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 4999 00000100:00080000:3.0:1767320099.361084:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320099.361092:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320099.361104:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320099.361138:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291954816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320099.361207:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320099.362562:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320099.362577:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291954944:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320099.368001:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320099.368016:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320099.368162:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291954816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320099.368358:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291954944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320099.617007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320099.681713:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320100.641058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320100.708858:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320101.665049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320101.729072:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320102.689539:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320102.753732:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320103.713020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320103.777100:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320104.483014:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320104.483031:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320104.483035:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320104.483038:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320104.483042:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320104.483052:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5004 00000100:00080000:1.0:1767320104.483063:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320104.483070:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320104.483081:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320104.483131:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291955072/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320104.483274:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291955200:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320104.483462:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320104.488855:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291955200:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320104.490202:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320104.490210:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320104.490214:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955072:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320104.737026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320104.806903:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320105.761012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320105.825127:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320106.785742:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320106.851294:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320107.808956:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320107.876373:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320108.834943:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320108.900193:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320109.603021:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320109.603032:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320109.603035:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320109.603039:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320109.603066:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320109.603077:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5009 00000100:00080000:0.0:1767320109.603088:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320109.603096:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320109.603109:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320109.603142:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291955328/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320109.605937:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320109.609979:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291955456:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320109.630071:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320109.630094:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320109.630101:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955328:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320109.630691:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291955456:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320109.857949:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320109.922705:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320110.881756:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320110.945139:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320111.906937:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320111.969985:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320112.929227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320112.993760:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320113.953163:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320114.022651:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320114.720998:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320114.721011:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320114.721014:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320114.721019:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320114.721024:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320114.721035:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5014 00000100:00080000:0.0:1767320114.721048:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320114.721056:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320114.721070:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320114.721111:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291955584/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320114.721189:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291955712:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320114.721407:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320089/real 1767320089] req@ffff8c3c5a28b100 x1853164291954176/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320114.721436:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b100 x1853164291954176/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320114.721455:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955584:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320114.721598:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320114.721658:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320114.721662:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291954176:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320114.721804:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320114.721809:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320114.721811:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320114.721815:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 4994 00000100:00080000:0.0:1767320114.721819:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320114.721823:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320114.721853:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291955840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320114.721906:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291955840:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320114.725963:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291955712:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320114.736631:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320114.736674:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320114.736680:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955584:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320114.977038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320115.041651:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320116.002830:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320116.071283:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320117.025559:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320117.095902:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320118.049029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320118.113169:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320119.073902:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320119.137415:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320119.841610:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320119.841620:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320119.841623:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320119.841627:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320119.841632:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320119.841642:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5019 00000100:00080000:2.0:1767320119.841651:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320119.841658:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320119.841670:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320119.841716:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291955968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320119.842140:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291956096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320119.842266:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955968:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320119.848183:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320119.848197:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320119.848202:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291955968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320119.848264:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291956096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320120.097200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320120.161431:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320121.121018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320121.185898:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320122.145058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320122.215466:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320123.169200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320123.233279:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320124.193021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320124.258501:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320124.961087:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320124.961102:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320124.961130:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320124.961135:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320124.961140:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320124.961152:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5024 00000100:00080000:3.0:1767320124.961168:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320124.961177:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320124.961191:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320124.961232:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291956224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320124.961298:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320124.961312:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320124.961326:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291956352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320124.967932:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291956352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320124.968132:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320124.968141:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320124.968145:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320125.217030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320125.281285:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320126.241430:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320126.305129:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320127.265223:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320127.329377:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320128.289197:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320128.353901:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320129.313020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320129.377155:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320130.081158:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320130.081195:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320130.081198:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320130.081202:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320130.081207:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320130.081220:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5029 00000100:00080000:2.0:1767320130.081234:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320130.081244:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320130.081259:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320130.081302:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291956480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320130.081373:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320130.081401:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291956608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320130.081909:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956480:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320130.089206:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320130.089228:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320130.089235:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320130.089532:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291956608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320130.337193:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320130.406354:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320131.361087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320131.427134:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320132.388025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320132.450316:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320133.409412:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320133.473550:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320134.433008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320134.497229:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320135.201067:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320135.201082:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320135.201086:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320135.201091:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320135.201097:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320135.201211:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5034 00000100:00080000:2.0:1767320135.201227:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320135.201237:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320135.201252:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320135.201296:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291956736/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320135.201390:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291956864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320135.201477:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956736:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320135.209216:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320135.209239:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320135.209246:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291956736:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320135.210457:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291956864:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320135.457061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320135.521212:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320136.481586:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320136.545135:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320137.505042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320137.569211:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320138.529016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320138.593043:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320139.297231:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320114/real 1767320114] req@ffff8c3c50e9c380 x1853164291955840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320139.297281:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9c380 x1853164291955840/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320139.298382:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320139.298423:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767320139.298454:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291955840:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320139.298622:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320139.298630:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320139.298634:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320139.298640:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5019 00000100:00080000:2.0:1767320139.298654:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320139.298662:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320139.298706:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291956992/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320139.298735:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320139.298738:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320139.298740:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320139.298744:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5040 00000100:00080000:2.0:1767320139.298753:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320139.298757:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320139.298769:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320139.298781:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291957120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320139.298837:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291956992:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320139.298845:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291957248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320139.302437:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320139.313142:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291957248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320139.313688:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320139.313697:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320139.313702:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320139.553019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320139.617129:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320140.577094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320140.642635:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320141.601261:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320141.665303:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320142.626322:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320142.691899:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320143.649614:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320143.713141:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320144.417028:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320144.417039:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320144.417042:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320144.417046:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320144.417050:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320144.417061:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5044 00000100:00080000:2.0:1767320144.417072:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320144.417079:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320144.417091:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320144.417125:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291957376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320144.417287:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291957504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320144.417843:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320144.432863:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291957504:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320144.433755:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320144.433764:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320144.433769:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320144.674059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320144.737201:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320145.699200:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320145.761503:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320146.721019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320146.785523:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320147.745034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320147.809046:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320148.770589:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320148.833215:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320149.537757:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320149.537773:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320149.537777:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320149.537781:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320149.537787:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320149.537802:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5049 00000100:00080000:3.0:1767320149.537817:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320149.537828:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320149.537844:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320149.537905:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291957632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320149.537968:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320149.537980:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291957760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320149.538274:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320149.545962:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291957760:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320149.546047:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320149.546057:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320149.546061:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320149.793005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320149.857156:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320150.817022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320150.885131:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320151.841020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320151.911697:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320152.865975:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320152.929227:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320153.889037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320153.953675:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320154.657162:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320154.657183:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320154.657186:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320154.657191:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320154.657197:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320154.657210:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5054 00000100:00080000:3.0:1767320154.657226:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320154.657238:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320154.657254:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320154.657300:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291957888/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320154.657430:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291958016:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320154.658469:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320154.660954:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291958016:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320154.661147:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320154.661155:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320154.661160:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291957888:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320154.913196:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320154.977240:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320155.937199:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320156.001232:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320156.961239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320157.028280:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320157.985039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320158.049970:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320159.009019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320159.073297:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320159.777382:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320159.777397:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320159.777401:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320159.777405:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320159.777411:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320159.777425:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5059 00000100:00080000:1.0:1767320159.777438:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320159.777447:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320159.777463:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320159.777509:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291958144/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320159.779009:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291958272:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320159.779761:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958144:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320159.785669:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320159.785684:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320159.785690:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958144:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320159.786858:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291958272:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320160.034530:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320160.098570:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320161.057027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320161.124538:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320162.080991:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320162.145151:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320163.105025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320163.169317:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320164.129031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320164.193128:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320164.897224:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320139/real 1767320139] req@ffff8c3c5a289f80 x1853164291956992/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320164.897269:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289f80 x1853164291956992/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320164.897307:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320164.897319:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320164.897323:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291956992:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320164.900090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320164.900102:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320164.900107:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320164.900119:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5044 00000100:00080000:1.0:1767320164.900133:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320164.900142:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320164.900183:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291958400/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320164.900232:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320164.900236:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320164.900238:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320164.900242:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5064 00000100:00080000:1.0:1767320164.900246:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320164.900251:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320164.900262:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320164.900283:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291958528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320164.900412:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291958400:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320164.900525:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320164.900826:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291958656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320164.903298:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320164.903317:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320164.903323:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320164.905612:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291958656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320165.153034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320165.217754:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320166.177021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320166.241243:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320167.202147:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320167.268682:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320168.227145:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320168.289239:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320169.249160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320169.313531:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320170.017002:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320170.017015:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320170.017018:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320170.017031:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320170.017037:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320170.017049:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5069 00000100:00080000:1.0:1767320170.017061:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320170.017069:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320170.017082:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320170.017125:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291958784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320170.017197:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320170.017238:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291958912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320170.017256:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958784:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320170.036974:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320170.036996:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320170.037003:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291958784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320170.041961:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291958912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320170.273412:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320170.338128:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320171.297057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320171.361673:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320172.321046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320172.388687:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320173.345040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320173.409153:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320174.369204:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320174.433141:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320175.137032:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320175.137047:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320175.137051:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320175.137079:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320175.137084:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320175.137108:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5074 00000100:00080000:3.0:1767320175.137122:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320175.137130:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320175.137145:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320175.137220:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291959040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320175.137311:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320175.137337:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291959168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320175.138427:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320175.143500:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291959168:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320175.151338:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320175.151359:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320175.151365:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320175.395491:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320175.457920:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320176.417181:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320176.485326:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320177.441340:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320177.505055:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320178.468290:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320178.531718:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320179.493326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320179.561114:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320180.261817:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320180.261833:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320180.261836:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320180.261840:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320180.261846:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320180.261860:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5080 00000100:00080000:2.0:1767320180.261913:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320180.261923:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320180.261939:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320180.261986:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291959296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320180.262072:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320180.262094:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291959424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320180.262998:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959296:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320180.265327:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320180.265343:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320180.265349:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320180.266346:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291959424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320180.513229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320180.577225:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320181.537029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320181.602670:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320182.561039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320182.626046:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320183.585012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320183.649367:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320184.609131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320184.673033:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320185.377149:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320185.377165:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320185.377190:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320185.377195:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320185.377201:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320185.377216:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5085 00000100:00080000:2.0:1767320185.377232:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320185.377255:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320185.377271:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320185.377320:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291959552/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320185.377417:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320185.377426:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320185.377447:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291959680:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320185.381995:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320185.382009:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320185.382014:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959552:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320185.382084:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291959680:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320185.633096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320185.697173:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320186.657015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320186.721174:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320187.681019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320187.745117:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320188.705048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320188.769652:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320189.475146:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320164/real 1767320164] req@ffff8c3c46ab2300 x1853164291958400/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320189 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320189.475191:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab2300 x1853164291958400/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320189.475212:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320189.475369:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320189.475374:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291958400:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320189.478579:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320189.478592:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320189.478597:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320189.478610:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5069 00000100:00080000:1.0:1767320189.478624:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320189.478632:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320189.478681:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291959808/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320189.478765:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291959808:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320189.480813:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320189.480825:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320189.480830:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320189.480840:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5090 00000100:00080000:1.0:1767320189.480850:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320189.480857:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320189.480886:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320189.480919:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0e00 x1853164291959936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320189.482381:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320189.482674:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291960064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320189.496063:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291960064:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320189.504025:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320189.504047:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320189.504067:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291959936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320189.729007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320189.793117:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320190.753067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320190.819411:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320191.778113:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320191.841964:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320192.801034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320192.865287:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320193.825037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320193.889572:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320194.595291:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320194.595304:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320194.595307:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320194.595311:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320194.595316:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320194.595327:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5094 00000100:00080000:1.0:1767320194.595340:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320194.595348:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320194.595362:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320194.595403:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291960192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320194.595479:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320194.595497:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291960320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320194.596518:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320194.600801:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291960320:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320194.600982:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320194.600989:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320194.600992:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320194.849375:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320194.916660:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320195.873061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320195.937340:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320196.899413:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320196.961223:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320197.920993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320197.985208:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320198.946505:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320199.011865:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320199.713263:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320199.713279:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320199.713283:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320199.713287:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320199.713293:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320199.713308:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5099 00000100:00080000:3.0:1767320199.713323:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320199.713332:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320199.713347:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320199.713395:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291960448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320199.713486:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320199.713685:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291960576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320199.717399:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767320199.717424:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291960576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320199.717430:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320199.717439:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320199.969448:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320200.034730:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320200.993595:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320201.057300:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320202.017812:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320202.090006:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320203.041112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320203.105349:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320204.070153:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320204.129403:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320204.833387:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320204.833400:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320204.833404:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320204.833408:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320204.833413:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320204.833427:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5104 00000100:00080000:3.0:1767320204.833441:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320204.833450:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320204.833466:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320204.833512:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291960704/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320204.833607:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291960832:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320204.834487:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320204.836964:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291960832:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320204.838402:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320204.838415:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320204.838420:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960704:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320205.089103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320205.153432:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320206.113047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320206.177718:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320207.137056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320207.201149:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320208.161024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320208.225172:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320209.185022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320209.249091:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320209.953128:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320209.953143:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320209.953146:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320209.953150:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320209.953178:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320209.953372:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5109 00000100:00080000:2.0:1767320209.953386:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320209.953396:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320209.953411:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320209.953719:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291960960/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320209.953797:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320209.953812:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291961088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320209.954168:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960960:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320209.960002:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320209.960022:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320209.960029:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291960960:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320209.960932:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291961088:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320210.209603:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320210.276119:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320211.233583:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320211.297233:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320212.258328:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320212.322090:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320213.281035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320213.345452:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320214.049043:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320189/real 1767320189] req@ffff8c3c46ab1180 x1853164291959808/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320214 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320214.049093:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab1180 x1853164291959808/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320214 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320214.049119:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320214.049205:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320214.049211:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291959808:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320214.053009:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320214.053024:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320214.053029:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320214.053043:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5094 00000100:00080000:3.0:1767320214.053056:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320214.053065:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320214.053133:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291961216/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320214.053168:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320214.053172:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320214.053174:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320214.053178:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5114 00000100:00080000:3.0:1767320214.053182:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320214.053186:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320214.053197:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320214.053214:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291961344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320214.053309:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291961216:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320214.053431:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320214.056235:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291961472:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320214.067262:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320214.067285:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320214.067291:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320214.068027:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291961472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320214.306280:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320214.369924:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320215.329067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320215.395011:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320216.352965:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320216.417180:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320217.376953:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320217.441725:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320218.401032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320218.465670:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320219.169303:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320219.169350:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320219.169354:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320219.169358:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320219.169363:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320219.169377:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5118 00000100:00080000:1.0:1767320219.169391:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320219.169399:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320219.169413:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320219.169452:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291961600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320219.169567:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291961728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320219.169715:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320219.176851:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291961728:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320219.176996:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320219.177005:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320219.177009:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320219.425221:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320219.489148:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320220.449934:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320220.513128:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320221.473313:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320221.537303:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320222.497402:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320222.561303:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320223.521025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320223.585502:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320224.289445:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320224.289456:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320224.289459:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320224.289462:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320224.289466:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320224.289478:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5124 00000100:00080000:3.0:1767320224.289491:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320224.289498:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320224.289511:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320224.289550:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291961856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320224.289764:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320224.290297:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291961984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320224.295642:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291961984:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320224.295847:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320224.295856:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320224.295860:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291961856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320224.545185:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320224.609311:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320225.569111:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320225.633155:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320226.593923:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320226.657975:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320227.617118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320227.681240:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320228.641688:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320228.705272:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320229.409298:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320229.409312:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320229.409316:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320229.409321:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320229.409326:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320229.409340:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5129 00000100:00080000:3.0:1767320229.409355:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320229.409363:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320229.409379:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320229.409425:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291962112/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320229.409505:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320229.409536:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291962240:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320229.410192:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320229.413225:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291962240:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320229.416057:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320229.416098:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320229.416104:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962112:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320229.665346:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320229.729087:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320230.689326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320230.756662:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320231.713251:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320231.777224:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320232.739206:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320232.802593:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320233.761061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320233.825111:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320234.529277:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320234.529288:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320234.529292:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320234.529296:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320234.529312:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320234.529404:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5134 00000100:00080000:3.0:1767320234.529416:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320234.529424:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320234.529535:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320234.529567:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291962368/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320234.529689:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291962496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320234.530253:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962368:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320234.558131:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320234.558158:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320234.558165:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962368:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320234.558178:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291962496:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320234.785039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320234.849552:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320235.809594:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320235.873156:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320236.833230:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320236.897616:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320237.857055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320237.922743:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320238.883129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320238.945186:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320239.648989:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320239.648997:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1767320239.648998:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320214/real 1767320214] req@ffff8c3c58fc2680 x1853164291961216/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320239 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320239.649000:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320239.649003:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320239.649007:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320239.649012:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5139 00000100:00080000:3.0:1767320239.649022:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1767320239.649025:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291961216/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320239 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320239.649029:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320239.649039:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:0.0:1767320239.649042:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320239.649069:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767320239.649070:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291962624/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320239.649073:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291961216:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320239.649094:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962624:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320239.649118:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320239.649121:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320239.649123:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320239.649126:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5118 00000100:00080000:3.0:1767320239.649129:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320239.649131:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320239.649141:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291962880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320239.649268:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291962752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320239.649274:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291962880:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320239.668142:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320239.668156:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320239.668162:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291962624:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320239.671493:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291962752:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320239.906568:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320239.972984:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320240.929058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320240.993159:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320241.958388:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320242.018715:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320242.976989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320243.042184:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320244.001665:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320244.065739:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320244.769632:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320244.769641:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320244.769644:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320244.769648:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320244.769652:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320244.769661:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5144 00000100:00080000:1.0:1767320244.769674:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320244.769681:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320244.769692:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320244.769725:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291963008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320244.769796:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320244.769995:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320244.770005:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291963136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320244.772455:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291963136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320244.774001:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320244.774028:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320244.774033:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320245.026295:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320245.090217:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320246.049891:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320246.114594:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320247.073002:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320247.137538:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320248.097009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320248.161736:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320249.121114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320249.185021:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320249.889754:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320249.889770:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320249.889774:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320249.889779:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320249.889784:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320249.889800:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5149 00000100:00080000:2.0:1767320249.889815:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320249.889825:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320249.889843:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320249.889939:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291963264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320249.890032:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320249.890613:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320249.890631:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291963392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320249.896954:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320249.896977:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320249.896984:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320249.899369:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291963392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320250.145027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320250.209290:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320251.169012:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320251.233428:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320252.201295:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320252.259003:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320253.217047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320253.281271:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320254.241141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320254.305285:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320255.009156:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320255.009171:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320255.009175:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320255.009179:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320255.009184:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320255.009198:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5154 00000100:00080000:1.0:1767320255.009214:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320255.009224:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320255.009243:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320255.009438:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291963520/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320255.009546:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291963648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320255.010281:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963520:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320255.017300:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320255.017335:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320255.017342:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963520:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320255.020031:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291963648:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320255.265013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320255.330047:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320256.290160:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320256.354085:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320257.313060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320257.378891:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320258.338555:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320258.401398:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320259.361385:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320259.425427:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320260.131828:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320260.131843:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320260.131845:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320260.131850:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320260.131856:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320260.131885:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5159 00000100:00080000:1.0:1767320260.131900:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320260.131909:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320260.131923:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320260.131969:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164291963776/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320260.134242:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291963904:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320260.134290:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320260.143574:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291963904:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320260.144229:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320260.144239:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320260.144243:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291963776:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320260.385319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320260.449353:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320261.409099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320261.480706:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320262.433308:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320262.498936:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320263.457018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320263.523110:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320264.225051:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320239/real 1767320239] req@ffff8c3c58fc0700 x1853164291962880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320264.225094:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0700 x1853164291962880/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320264.225131:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320264.225144:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320264.225149:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291962880:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320264.225316:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320264.225323:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320264.225326:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320264.225333:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5144 00000100:00080000:0.0:1767320264.225344:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320264.225352:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320264.225630:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291964032/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320264.225660:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320264.225664:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320264.225666:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320264.225671:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5165 00000100:00080000:0.0:1767320264.225675:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320264.225679:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320264.225690:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320264.226557:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291964032:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320264.226761:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291964160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320264.226827:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291964288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320264.226941:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964160:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320264.232684:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320264.232706:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320264.232712:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320264.232792:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291964288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320264.481025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320264.545319:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320265.505973:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320265.569250:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320266.531955:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320266.593327:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320267.553215:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320267.617165:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320268.580851:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320268.641108:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320269.345093:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320269.345107:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320269.345110:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320269.345115:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320269.345121:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320269.345134:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5169 00000100:00080000:3.0:1767320269.345148:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320269.345156:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320269.345168:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320269.345206:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291964416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320269.345265:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320269.345776:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291964544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320269.353605:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320269.353627:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320269.353634:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320269.356959:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291964544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320269.601029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320269.665291:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320270.625154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320270.689451:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320271.649270:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320271.713264:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320272.673621:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320272.738391:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320273.697034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320273.761557:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320274.465784:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320274.465799:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320274.465802:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320274.465831:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320274.465836:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320274.465850:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5174 00000100:00080000:1.0:1767320274.465864:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320274.465897:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320274.465913:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320274.465956:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164291964672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320274.466043:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320274.466359:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291964800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320274.488004:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291964800:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320274.488150:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320274.488159:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320274.488163:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320274.721762:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320274.785191:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320275.744993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320275.809125:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320276.769444:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320276.833072:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320277.793031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320277.857269:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320278.817058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320278.883345:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320279.586428:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320279.586439:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320279.586443:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320279.586448:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320279.586453:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320279.586467:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5179 00000100:00080000:2.0:1767320279.586480:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320279.586490:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320279.586515:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320279.586744:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291964928/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320279.586835:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965056:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320279.588000:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320279.602746:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965056:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320279.604394:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320279.604412:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320279.604418:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291964928:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320279.843280:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320279.905200:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320280.867654:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320280.929370:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320281.889008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320281.953858:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320282.913071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320282.977938:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320283.937020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320284.001151:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320284.706524:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320284.706540:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320284.706543:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320284.706548:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320284.706554:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320284.706567:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5184 00000100:00080000:3.0:1767320284.706581:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320284.706589:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320284.706615:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320284.706682:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291965184/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320284.706759:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320284.706776:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965312:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320284.706795:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320284.724275:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965312:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320284.728279:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320284.728301:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320284.728307:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965184:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320284.961476:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320285.025919:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320285.985021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320286.049513:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320287.011921:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320287.073196:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320288.032997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320288.097137:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320289.057021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320289.121443:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320289.825042:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320264/real 1767320264] req@ffff8c3c50e9ed80 x1853164291964032/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320289.825086:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ed80 x1853164291964032/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320289.825091:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320289.825099:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320289.825102:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320289.825112:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320289.825130:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320289.825134:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320289.825145:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00080000:2.0:1767320289.825152:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5189 00000100:00100000:1.0:1767320289.825154:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291964032:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320289.825169:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320289.825181:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320289.825196:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320289.825232:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291965440/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320289.825317:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320289.825322:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320289.825324:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320289.825328:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5169 00000100:00080000:2.0:1767320289.825332:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320289.825336:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320289.825349:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291965696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320289.825372:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320289.825386:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291965568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320289.825436:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320289.829284:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291965696:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320289.832634:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320289.832672:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320289.832679:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965440:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320289.833485:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291965568:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320290.081034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320290.152246:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320291.105385:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320291.169565:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320292.129806:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320292.193412:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320293.153405:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320293.217170:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320294.177044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320294.242116:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320294.946195:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320294.946207:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320294.946209:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320294.946213:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320294.946218:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320294.946228:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5194 00000100:00080000:3.0:1767320294.946241:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320294.946249:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320294.946261:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320294.946316:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291965824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320294.946418:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320294.946441:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320294.946450:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965824:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320294.953867:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320294.953900:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320294.953909:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291965824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320294.954824:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291965952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320295.201212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320295.265398:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320296.224966:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320296.289235:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320297.249234:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320297.313324:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320298.273092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320298.337122:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320299.297179:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320299.361469:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320300.065090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320300.065128:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320300.065131:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320300.065136:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320300.065141:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320300.065157:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5199 00000100:00080000:0.0:1767320300.065172:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320300.065181:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320300.065196:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320300.065240:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291966080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320300.065998:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291966208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320300.066091:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320300.070137:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291966208:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320300.070202:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320300.070211:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320300.070216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320300.321021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320300.386225:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320301.345229:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320301.410365:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320302.369240:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320302.434210:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320303.393028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320303.457534:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320304.417034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320304.483316:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320305.185338:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320305.185352:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320305.185356:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320305.185381:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320305.185386:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320305.185399:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5204 00000100:00080000:3.0:1767320305.185413:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320305.185422:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320305.185437:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320305.185478:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164291966336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320305.185559:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320305.185573:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291966464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320305.186062:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320305.189507:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291966464:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320305.189722:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320305.189730:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320305.189735:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320305.441025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320305.505149:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320306.465042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320306.529088:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320307.489052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320307.553676:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320308.513048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320308.577226:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320309.537043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320309.601196:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320310.305164:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320310.305181:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320310.305185:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320310.305189:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320310.305194:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320310.305207:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5210 00000100:00080000:0.0:1767320310.305223:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320310.305232:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320310.305247:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320310.305290:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291966592/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320310.305445:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291966720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320310.305649:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966592:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320310.320534:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320310.320554:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320310.320561:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966592:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320310.323199:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291966720:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320310.561081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320310.625485:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320311.586924:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320311.649248:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320312.612359:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320312.673389:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320313.633038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320313.698092:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320314.401070:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320289/real 1767320289] req@ffff8c3c5a28b100 x1853164291965696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320314 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320314.401116:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b100 x1853164291965696/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320314 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320314.401140:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320314.401260:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320314.401286:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291965696:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320314.401582:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320314.401589:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320314.401593:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320314.401600:0:8441:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5194 00000100:00080000:3.0:1767320314.401613:0:8441:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320314.401621:0:8441:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320314.402043:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291966848/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320314.402108:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291966848:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320314.402237:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320314.402242:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320314.402245:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320314.402250:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5215 00000100:00080000:3.0:1767320314.402265:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320314.402271:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320314.402283:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320314.402298:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291966976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320314.402505:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320314.403668:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291967104:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320314.416959:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320314.416982:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320314.416988:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291966976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320314.417218:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291967104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320314.657038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320314.723136:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320315.682308:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320315.748944:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320316.705027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320316.769111:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320317.729059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320317.793817:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320318.753021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320318.817128:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320319.523793:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320319.523807:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320319.523810:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320319.523814:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320319.523829:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320319.523843:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5219 00000100:00080000:3.0:1767320319.523857:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320319.523912:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320319.523926:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320319.523974:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291967232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320319.524055:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320319.524073:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291967360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320319.524379:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967232:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320319.528504:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767320319.528514:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291967360:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320319.528520:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320319.528528:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320319.777035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320319.842854:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320320.801007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320320.865142:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320321.825807:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320321.889173:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320322.849191:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320322.913161:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320323.873028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320323.937480:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320324.646211:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320324.646222:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320324.646226:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320324.646230:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320324.646235:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320324.646246:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5224 00000100:00080000:0.0:1767320324.646257:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320324.646264:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320324.646277:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320324.646324:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291967488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320324.646701:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320324.646851:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291967616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320324.654503:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320324.654520:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320324.654525:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320324.661621:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291967616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320324.897041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320324.961367:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320325.921116:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320325.985125:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320326.945019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320327.009164:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320327.969030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320328.034259:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320328.995183:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320329.057387:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320329.761012:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320329.761027:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320329.761053:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320329.761058:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320329.761063:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320329.761076:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5229 00000100:00080000:0.0:1767320329.761090:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320329.761099:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320329.761114:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320329.761174:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291967744/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320329.761271:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291967872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320329.761867:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967744:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320329.782981:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320329.783002:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320329.783027:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291967744:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320329.784788:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291967872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320330.017146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320330.081033:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320331.041048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320331.108863:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320332.065016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320332.129037:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320333.089003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320333.153159:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320334.113068:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320334.182972:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320334.881310:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320334.881321:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320334.881324:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320334.881328:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320334.881332:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320334.881343:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5234 00000100:00080000:2.0:1767320334.881354:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320334.881362:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320334.881373:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320334.881408:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291968000/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320334.881521:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291968128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320334.881531:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968000:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320334.887690:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320334.887721:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320334.887737:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968000:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320334.887922:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291968128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320335.137267:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320335.201153:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320336.161089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320336.225287:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320337.186033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320337.250951:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320338.209007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320338.276994:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320339.234602:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320339.297186:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320340.001822:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320314/real 1767320314] req@ffff8c3c58fc0380 x1853164291966848/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320340.001868:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0380 x1853164291966848/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320340.001923:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320340.001941:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767320340.001945:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291966848:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320340.002081:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320340.002087:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320340.002091:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320340.002097:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5219 00000100:00080000:0.0:1767320340.002108:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320340.002116:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320340.002158:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291968256/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320340.002190:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320340.002194:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320340.002214:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320340.002219:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5239 00000100:00080000:0.0:1767320340.002224:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320340.002228:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320340.002239:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320340.002253:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291968384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320340.002946:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291968512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320340.006979:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291968256:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767320340.007109:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320340.011400:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291968512:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320340.015535:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320340.015556:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320340.015563:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320340.257024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320340.321079:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320341.281077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320341.345302:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320342.305008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320342.369246:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320343.329352:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320343.393127:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320344.353809:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320344.417147:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320345.121167:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320345.121182:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320345.121185:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320345.121189:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320345.121194:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320345.121208:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5244 00000100:00080000:1.0:1767320345.121223:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320345.121231:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320345.121257:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320345.121335:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164291968640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320345.121424:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320345.121446:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291968768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320345.123941:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968640:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320345.128023:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320345.128044:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320345.128050:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320345.128173:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291968768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320345.377124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320345.441155:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320346.403555:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320346.465176:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320347.424989:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320347.489266:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320348.449465:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320348.513433:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320349.473027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320349.537194:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320350.241074:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320350.241087:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320350.241090:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320350.241094:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320350.241100:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320350.241113:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5250 00000100:00080000:1.0:1767320350.241126:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320350.241134:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320350.241150:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320350.241194:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164291968896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320350.241272:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320350.241310:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291969024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320350.241793:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968896:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320350.251537:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320350.251559:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320350.251566:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291968896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320350.251682:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291969024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320350.497841:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320350.564625:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320351.522150:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320351.589703:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320352.545036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320352.611508:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320353.569021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320353.633254:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320354.593017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320354.657104:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320355.363437:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320355.363452:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320355.363455:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320355.363460:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320355.363466:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320355.363479:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5255 00000100:00080000:0.0:1767320355.363493:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320355.363502:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320355.363516:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320355.363572:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291969152/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320355.363726:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291969280:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320355.364046:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320355.371336:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291969280:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320355.372386:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320355.372400:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320355.372404:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969152:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320355.617134:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320355.681344:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320356.641018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320356.705181:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320357.665016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320357.729919:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320358.689020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320358.754087:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320359.713020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320359.777093:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320360.482087:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320360.482101:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320360.482104:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320360.482108:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320360.482114:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320360.482126:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5260 00000100:00080000:2.0:1767320360.482141:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320360.482150:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320360.482166:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320360.482210:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291969408/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320360.482780:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291969536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320360.482950:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969408:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320360.495797:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320360.495817:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320360.495823:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969408:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320360.495857:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291969536:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320360.737753:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320360.801163:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320361.761026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320361.828086:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320362.785076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320362.849809:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320363.811326:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320363.874019:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320364.832977:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320364.897580:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320365.601305:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320340/real 1767320340] req@ffff8c3c50e9ce00 x1853164291968256/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320365 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320365.601341:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ce00 x1853164291968256/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320365 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320365.601360:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320365.601372:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767320365.601378:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291968256:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320365.601530:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320365.601535:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320365.601538:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320365.601542:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5244 00000100:00080000:2.0:1767320365.601549:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320365.601567:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320365.601592:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291969664/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320365.601613:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320365.601615:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320365.601617:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320365.601620:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5265 00000100:00080000:2.0:1767320365.601622:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320365.601625:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320365.601632:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320365.601640:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291969792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320365.601689:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291969920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320365.602854:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291969664:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767320365.602936:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320365.618392:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291969920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320365.626165:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320365.626178:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320365.626213:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291969792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320365.857285:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320365.921018:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320366.880980:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320366.945540:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320367.905027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320367.969661:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320368.929098:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320368.993141:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320369.953035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320370.019293:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320370.721001:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320370.721013:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320370.721016:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320370.721020:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320370.721025:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320370.721036:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5270 00000100:00080000:2.0:1767320370.721047:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320370.721075:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320370.721087:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320370.721118:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291970048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320370.721190:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291970176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320370.721443:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970048:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320370.735244:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320370.735255:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320370.735261:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320370.735394:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291970176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320370.977297:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320371.043260:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320372.001345:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320372.066238:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320373.025134:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320373.091089:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320374.048998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320374.113237:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320375.074570:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320375.137153:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320375.841078:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320375.841089:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320375.841093:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320375.841097:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320375.841103:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320375.841114:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5275 00000100:00080000:2.0:1767320375.841125:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320375.841133:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320375.841145:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320375.841195:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291970304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320375.841280:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291970432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320375.842083:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970304:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320375.850654:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320375.850670:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320375.850675:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320375.851150:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291970432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320376.097016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320376.161967:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320377.121926:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320377.185260:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320378.145020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320378.209647:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320379.170945:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320379.233295:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320380.193019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320380.257070:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320380.961009:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320380.961020:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320380.961023:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320380.961044:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320380.961049:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320380.961058:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5280 00000100:00080000:2.0:1767320380.961069:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320380.961075:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320380.961086:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320380.961115:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291970560/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320380.961205:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291970688:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320380.961222:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970560:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320380.963106:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767320380.963112:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291970688:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320380.963118:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320380.963126:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970560:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320381.217081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320381.281060:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320382.247331:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320382.306081:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320383.265173:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320383.330509:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320384.290484:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320384.358299:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320385.313026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320385.379364:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320386.084933:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320386.084944:0:8441:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320386.084947:0:8441:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320386.084950:0:8441:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320386.084955:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320386.084966:0:8441:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5285 00000100:00080000:3.0:1767320386.084978:0:8441:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320386.084986:0:8441:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320386.084997:0:8441:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320386.085037:0:8441:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291970816/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320386.085182:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291970944:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320386.086150:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320386.089986:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291970944:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320386.090391:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320386.090398:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320386.090404:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291970816:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320386.337588:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320386.401388:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320387.361013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320387.425055:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320388.385042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320388.449304:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320389.409050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320389.473201:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320390.177049:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320365/real 1767320365] req@ffff8c3c5a288a80 x1853164291969664/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320390 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320390.177084:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a288a80 x1853164291969664/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320390 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320390.177103:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320390.177139:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320390.177144:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291969664:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320390.177407:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320390.177446:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320390.177449:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320390.177454:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5270 00000100:00080000:0.0:1767320390.177466:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320390.177502:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320390.177532:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291971072/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320390.177558:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320390.177562:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320390.177564:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320390.177568:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5290 00000100:00080000:0.0:1767320390.177571:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320390.177575:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320390.177584:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320390.177598:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291971200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320390.177675:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291971328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320390.177853:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291971072:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320390.177931:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320390.192123:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291971328:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320390.192313:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320390.192320:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320390.192324:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320390.434350:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320390.497698:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320391.458115:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320391.521499:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320392.483866:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320392.545104:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320393.505470:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320393.577908:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320394.529034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320394.593109:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320395.297288:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320395.297299:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320395.297302:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320395.297306:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320395.297310:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320395.297321:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5295 00000100:00080000:0.0:1767320395.297331:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320395.297360:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320395.297372:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320395.297402:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291971456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320395.298214:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291971584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320395.300226:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971456:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320395.303869:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320395.303912:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320395.303916:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320395.305461:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291971584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320395.553362:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320395.617328:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320396.577317:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320396.641187:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320397.601049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320397.666011:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320398.625180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320398.689129:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320399.649605:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320399.714065:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320400.417037:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320400.417047:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320400.417051:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320400.417055:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320400.417059:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320400.417068:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5300 00000100:00080000:0.0:1767320400.417078:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320400.417084:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320400.417102:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320400.417140:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291971712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320400.417210:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320400.418774:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320400.418795:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291971840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320400.430196:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320400.430211:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320400.430216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320400.436803:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291971840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320400.673499:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320400.738196:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320401.697054:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320401.761507:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320402.724141:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320402.789445:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320403.745027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320403.809196:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320404.773260:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320404.835585:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320405.538350:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320405.538362:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320405.538365:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320405.538369:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320405.538375:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320405.538385:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5305 00000100:00080000:1.0:1767320405.538397:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320405.538404:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320405.538416:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320405.538453:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164291971968/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320405.538536:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320405.538575:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291972096:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320405.539462:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971968:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320405.545951:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767320405.545960:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291972096:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320405.545963:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320405.545967:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291971968:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320405.792943:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320405.857303:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320406.817017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320406.882500:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320407.841227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320407.905137:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320408.867402:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320408.929367:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320409.891965:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320409.953238:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320410.657079:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320410.657095:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320410.657099:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320410.657104:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320410.657110:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320410.657231:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5310 00000100:00080000:1.0:1767320410.657245:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320410.657254:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320410.657269:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320410.657312:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164291972224/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320410.657407:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320410.657412:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320410.657431:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972352:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320410.678653:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972352:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320410.679565:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320410.679579:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320410.679584:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972224:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320410.913429:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320410.991343:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320411.937015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320412.001793:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320412.961352:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320413.025109:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320413.988312:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320414.049530:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320415.009450:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320415.073083:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320415.777105:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320415.777119:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320415.777123:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320415.777128:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320415.777133:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320415.777147:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5315 00000100:00080000:1.0:1767320415.777161:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320415.777180:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320415.777195:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320415.777240:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164291972480/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320415.777345:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320415.777751:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320390/real 1767320390] req@ffff8c3c50e9dc00 x1853164291971072/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320415.777797:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9dc00 x1853164291971072/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320415.777813:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972480:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320415.777853:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320415.777909:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320415.777915:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291971072:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320415.778083:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320415.778088:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320415.778090:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320415.778096:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5295 00000100:00080000:1.0:1767320415.778101:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320415.778107:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320415.778125:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164291972736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320415.778499:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291972736:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320415.783764:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320415.783788:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320415.783795:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972480:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320415.785474:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972608:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320416.033747:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320416.100086:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320417.057048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320417.121265:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320418.081025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320418.146154:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320419.105178:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320419.169185:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320420.129081:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320420.195152:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320420.897106:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320420.897130:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320420.897133:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320420.897137:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320420.897143:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320420.897156:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5320 00000100:00080000:0.0:1767320420.897170:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320420.897178:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320420.897202:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320420.897255:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291972864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320420.897344:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320420.897362:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320420.900048:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320420.911061:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291972992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320420.912605:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320420.912620:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320420.912626:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291972864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320421.153296:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320421.217200:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320422.177108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320422.241380:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320423.201026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320423.266783:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320424.225045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320424.289115:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320425.249064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320425.313060:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320426.017088:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320426.017105:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320426.017109:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320426.017113:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320426.017119:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320426.017134:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5325 00000100:00080000:1.0:1767320426.017151:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320426.017161:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320426.017178:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320426.017225:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164291973120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320426.017421:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320426.017515:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320426.017552:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291973248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320426.020567:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291973248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320426.023120:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320426.023134:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320426.023139:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320426.273025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320426.337131:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320427.297216:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320427.361182:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320428.321038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320428.385238:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320429.345130:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320429.409816:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320430.369251:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320430.433530:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320431.137181:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320431.137190:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320431.137212:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320431.137216:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320431.137229:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320431.137238:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5330 00000100:00080000:2.0:1767320431.137250:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320431.137256:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320431.137267:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320431.137298:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291973376/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320431.137371:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320431.137387:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291973504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320431.137554:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973376:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320431.146598:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320431.146612:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320431.146616:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973376:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320431.146685:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291973504:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320431.393621:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320431.458272:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320432.417057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320432.485343:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320433.442425:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320433.505045:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320434.465019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320434.530339:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320435.491067:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320435.553521:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320436.256986:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320436.256997:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320436.257000:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320436.257004:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320436.257028:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320436.257039:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5336 00000100:00080000:2.0:1767320436.257050:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320436.257056:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320436.257069:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320436.257100:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291973632/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320436.257229:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320436.257266:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291973760:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320436.261964:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291973760:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320436.263931:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320436.263949:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320436.263956:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291973632:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320436.513029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320436.577235:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320437.538946:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320437.601150:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320438.562372:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320438.628888:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320439.585030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320439.649035:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320440.353047:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320415/real 1767320415] req@ffff8c3c46ab0a80 x1853164291972736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320440 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320440.353098:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0a80 x1853164291972736/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320440 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320440.353118:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320440.353149:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320440.353154:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291972736:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320440.353366:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320440.353371:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320440.353373:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320440.353378:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5320 00000100:00080000:1.0:1767320440.353386:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320440.353391:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320440.353424:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291973888/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320440.353452:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320440.353456:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320440.353457:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320440.353461:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5341 00000100:00080000:1.0:1767320440.353465:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320440.353468:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320440.353477:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320440.353506:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164291974016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320440.353555:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320440.353565:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291974144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320440.353957:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291973888:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320440.354013:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320440.367371:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291974144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320440.367633:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320440.367640:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320440.367645:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320440.610437:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320440.673209:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320441.633018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320441.697929:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320442.657024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320442.721214:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320443.681050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320443.745075:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320444.722908:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320444.769156:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320445.473345:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320445.473354:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320445.473358:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320445.473362:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320445.473367:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320445.473377:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5345 00000100:00080000:2.0:1767320445.473395:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320445.473422:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320445.473433:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320445.473462:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291974272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320445.473561:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291974400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320445.473712:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974272:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320445.477979:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320445.477996:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320445.478002:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320445.478169:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291974400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320445.729133:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320445.793368:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320446.754752:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320446.819247:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320447.777026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320447.841571:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320448.802091:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320448.865210:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320449.825306:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320449.889368:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320450.593039:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320450.593050:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320450.593053:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320450.593057:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320450.593061:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320450.593072:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5350 00000100:00080000:2.0:1767320450.593083:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320450.593090:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320450.593102:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320450.593136:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291974528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320450.593224:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320450.593241:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291974656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320450.593838:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974528:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320450.598584:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320450.598601:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320450.598606:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320450.598981:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291974656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320450.849838:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320450.913581:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320451.873059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320451.937134:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320452.897094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320452.961337:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320453.921011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320453.986112:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320454.945933:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320455.009159:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320455.717023:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320455.717033:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320455.717036:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320455.717039:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320455.717043:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320455.717052:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5355 00000100:00080000:0.0:1767320455.717062:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320455.717069:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320455.717080:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320455.718708:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291974784/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320455.718903:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291974912:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320455.718903:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320455.731318:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291974912:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320455.737927:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320455.737946:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320455.737952:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291974784:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320455.969907:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320456.034177:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320456.993113:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320457.057740:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320458.023051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320458.081818:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320459.042621:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320459.105115:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320460.065021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320460.130168:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320460.836770:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320460.836782:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320460.836785:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320460.836789:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320460.836795:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320460.836806:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5360 00000100:00080000:2.0:1767320460.836819:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320460.836827:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320460.836839:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320460.836902:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291975040/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320460.837048:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291975168:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320460.838476:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320460.842754:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291975168:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320460.842850:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320460.842858:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320460.842862:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975040:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320461.089026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320461.153047:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320462.113922:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320462.179845:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320463.137047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320463.201288:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320464.164388:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320464.225085:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320465.185315:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320465.251532:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320465.953021:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1767320465.953032:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320440/real 1767320440] req@ffff8c3c46ab3800 x1853164291973888/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320465.953034:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320465.953039:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320465.953049:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320465.953054:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320465.953062:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5365 00000100:00080000:2.0:1767320465.953074:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320465.953096:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320465.953107:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3800 x1853164291973888/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1767320465.953113:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:1.0:1767320465.953132:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767320465.953157:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291975296/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320465.953163:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320465.953172:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291973888:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320465.953210:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975296:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320465.953214:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320465.953218:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320465.953220:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320465.953224:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5345 00000100:00080000:2.0:1767320465.953229:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320465.953233:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320465.953246:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291975552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320465.953723:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291975552:192.168.202.133@tcp:250:kworker.0 00000100:00100000:3.0:1767320465.966147:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291975424:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320465.971917:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291975424:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320465.972139:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320465.972148:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320465.972153:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975296:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320466.209083:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320466.273186:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320467.233154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320467.300359:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320468.257129:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320468.321442:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320469.282726:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320469.351392:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320470.305673:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:0.0:1767320470.369050:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320471.073042:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320471.073078:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320471.073082:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320471.073086:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320471.073091:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320471.073106:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5370 00000100:00080000:2.0:1767320471.073120:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320471.073128:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320471.073153:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320471.073204:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291975680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320471.073386:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291975808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320471.073960:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975680:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320471.078810:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320471.078836:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320471.078838:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291975808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320471.078848:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320471.329604:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320471.393373:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320472.354467:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320472.418122:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320473.377139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320473.445808:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320474.401037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320474.465224:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320475.424954:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320475.491271:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320476.197717:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320476.197731:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320476.197752:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320476.197756:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320476.197761:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320476.197771:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5375 00000100:00080000:1.0:1767320476.197785:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320476.197792:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320476.197805:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320476.197844:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164291975936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320476.197981:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320476.198000:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291976064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320476.198204:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975936:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320476.207171:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320476.207188:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320476.207193:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291975936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320476.207308:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291976064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320476.449038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320476.515715:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320477.473075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320477.537747:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320478.497021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320478.563196:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320479.521029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320479.588929:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320480.545040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320480.609596:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320481.316213:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320481.316225:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320481.316229:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320481.316232:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320481.316237:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320481.316248:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5381 00000100:00080000:3.0:1767320481.316280:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320481.316337:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320481.316351:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320481.316386:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164291976192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320481.316487:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320481.316520:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291976320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320481.319410:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320481.320612:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291976320:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320481.322133:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320481.322143:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320481.322148:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320481.570574:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320481.633100:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320482.593019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320482.657544:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320483.617095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320483.681167:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320484.641069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320484.705095:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320485.665029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320485.729402:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320486.433548:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320486.433560:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320486.433563:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320486.433567:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320486.433571:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320486.433581:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5386 00000100:00080000:3.0:1767320486.433592:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320486.433598:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320486.433609:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320486.433643:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164291976448/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320486.433742:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320486.433756:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291976576:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320486.434217:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320486.459951:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291976576:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320486.460187:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320486.460211:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320486.460214:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976448:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320486.689025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320486.753239:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320487.713691:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320487.778832:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320488.737073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320488.801238:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320489.767979:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320489.825525:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320490.529943:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320465/real 1767320465] req@ffff8c3c5a289c00 x1853164291975552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320490.529980:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289c00 x1853164291975552/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320490.530000:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320490.530031:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320490.530036:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291975552:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320490.530191:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320490.530196:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320490.530199:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320490.530205:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5370 00000100:00080000:2.0:1767320490.530214:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320490.530221:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320490.530255:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291976704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320490.530374:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320490.530378:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320490.530380:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320490.530385:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5391 00000100:00080000:2.0:1767320490.530389:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320490.530393:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320490.530404:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320490.530418:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291976832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320490.530476:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320490.530490:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291976960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320490.531097:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291976704:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320490.531153:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320490.533295:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291976960:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320490.537609:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320490.537626:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320490.537632:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291976832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320490.785059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320490.849234:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320491.815096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320491.873494:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320492.833628:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320492.897353:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320493.857608:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320493.923581:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320494.882755:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320494.945195:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320495.649010:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320495.649020:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320495.649024:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320495.649028:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320495.649032:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320495.649043:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5395 00000100:00080000:2.0:1767320495.649053:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320495.649060:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320495.649072:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320495.649109:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291977088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320495.649219:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320495.649238:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291977216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320495.649960:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977088:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320495.653041:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320495.653057:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320495.653062:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320495.653339:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291977216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320495.904950:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320495.969588:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320496.929039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320496.993092:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320497.953412:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320498.017137:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320498.977428:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320499.041306:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320500.004949:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320500.065355:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320500.771552:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320500.771563:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320500.771566:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320500.771570:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320500.771574:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320500.771583:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5400 00000100:00080000:2.0:1767320500.771592:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320500.771599:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320500.771610:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320500.771643:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291977344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320500.771727:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320500.771743:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291977472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320500.771966:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320500.778352:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320500.778370:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320500.778375:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320500.778472:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291977472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320501.025013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320501.090368:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320502.049567:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320502.113149:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320503.073663:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320503.137297:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320504.097114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320504.161249:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320505.121059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320505.185755:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320505.889403:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320505.889414:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320505.889438:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320505.889442:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320505.889446:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320505.889457:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5405 00000100:00080000:2.0:1767320505.889469:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320505.889476:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320505.889488:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320505.889533:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291977600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320505.889802:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291977728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320505.892177:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977600:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320505.894608:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320505.894622:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320505.894627:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320505.895319:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291977728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320506.144993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320506.209462:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320507.169528:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320507.233263:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320508.193038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320508.257541:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320509.217049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320509.286327:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320510.241021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320510.305785:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320511.009057:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320511.009067:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320511.009070:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320511.009074:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320511.009078:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320511.009088:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5410 00000100:00080000:1.0:1767320511.009099:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320511.009105:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320511.009117:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320511.009167:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0000 x1853164291977856/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320511.009276:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291977984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320511.009556:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977856:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320511.014813:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320511.014834:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320511.014840:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291977856:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320511.015681:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291977984:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320511.265032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320511.330541:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320512.289857:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320512.354825:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320513.313001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320513.377233:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320514.337014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320514.402479:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320515.105347:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320490/real 1767320490] req@ffff8c3c5a289c00 x1853164291976704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320515.105387:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289c00 x1853164291976704/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320515.105408:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320515.107588:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320515.107599:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291976704:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320515.124745:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320515.124757:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320515.124762:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320515.124771:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5395 00000100:00080000:1.0:1767320515.124781:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320515.124787:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320515.124823:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291978112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320515.124856:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320515.124860:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320515.124861:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320515.124865:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5415 00000100:00080000:1.0:1767320515.124893:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320515.124897:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320515.124913:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320515.124924:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291978240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320515.124982:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291978368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320515.126607:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291978112:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320515.126710:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320515.135868:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291978368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320515.139796:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320515.139812:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320515.139818:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320515.361555:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320515.425938:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320516.391227:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320516.453349:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320517.409028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320517.473135:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320518.433034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320518.497894:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320519.457867:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320519.521366:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320520.226954:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320520.226967:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320520.226971:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320520.226975:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320520.226981:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320520.226994:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5420 00000100:00080000:3.0:1767320520.227008:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320520.227078:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320520.227095:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320520.227141:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164291978496/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320520.227316:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320520.227855:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320520.227908:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291978624:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320520.248594:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320520.248616:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320520.248622:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320520.250116:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291978624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320520.481048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320520.548203:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320521.505309:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320521.569360:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320522.531705:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320522.593451:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320523.554932:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320523.617177:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320524.577023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320524.641358:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320525.350074:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320525.350084:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320525.350088:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320525.350093:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320525.350097:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320525.350108:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5425 00000100:00080000:1.0:1767320525.350121:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320525.350128:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320525.350140:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320525.350176:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291978752/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320525.350239:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291978880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320525.350711:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978752:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320525.360065:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320525.360084:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320525.360090:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291978752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320525.370048:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291978880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320525.601031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320525.669440:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320526.625319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320526.693769:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320527.649069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320527.716734:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320528.673762:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320528.737669:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320529.697051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320529.761524:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320530.468167:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320530.468181:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320530.468185:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320530.468189:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320530.468212:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320530.468225:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5430 00000100:00080000:2.0:1767320530.468240:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320530.468248:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320530.468262:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320530.468305:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291979008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320530.468396:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320530.468417:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291979136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320530.470069:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320530.470757:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291979136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320530.475368:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320530.475399:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320530.475406:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320530.721207:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320530.786147:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320531.745050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320531.809289:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320532.769285:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320532.833099:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320533.793148:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320533.858577:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320534.817149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320534.882149:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320535.585467:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320535.585481:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320535.585484:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320535.585488:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320535.585493:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320535.585506:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5435 00000100:00080000:3.0:1767320535.585520:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320535.585529:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320535.585545:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320535.585592:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164291979264/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320535.585676:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320535.585692:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291979392:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320535.586497:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320535.592508:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291979392:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320535.597456:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320535.597475:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320535.597481:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979264:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320535.841524:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320535.905293:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320536.865618:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320536.930793:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320537.891853:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320537.953278:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320538.914354:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320538.977832:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320539.937103:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320540.004243:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320540.705036:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320515/real 1767320515] req@ffff8c3c46ab0380 x1853164291978112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320540 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320540.705083:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab0380 x1853164291978112/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320540 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320540.705111:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320540.705119:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320540.705128:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320540.705133:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320540.705144:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00080000:2.0:1767320540.705145:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5420 00000100:00100000:0.0:1767320540.705154:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291978112:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320540.705171:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320540.705182:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320540.705231:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291979520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320540.705290:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320540.705294:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320540.705296:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320540.705300:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5440 00000100:00080000:2.0:1767320540.705305:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320540.705309:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320540.705320:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320540.705335:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291979648/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320540.705422:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320540.705439:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291979776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320540.705665:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291979520:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320540.705705:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979648:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320540.720014:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320540.720034:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320540.720041:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320540.722538:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291979776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320540.961831:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320541.025170:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320541.985765:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320542.049171:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320543.010310:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320543.073348:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320544.033748:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320544.097977:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320545.057494:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320545.121344:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320545.826381:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320545.826417:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320545.826421:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320545.826425:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320545.826431:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320545.826444:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5445 00000100:00080000:0.0:1767320545.826459:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320545.826469:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320545.826486:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320545.826536:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291979904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320545.826850:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291980032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320545.827066:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320545.829222:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291980032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320545.830178:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320545.830193:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320545.830198:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291979904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320546.081034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320546.145574:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320547.105577:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320547.169377:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320548.129119:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320548.193525:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320549.153542:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320549.219631:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320550.177193:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320550.241160:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320550.945994:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320550.946008:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320550.946011:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320550.946014:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320550.946019:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320550.946031:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5450 00000100:00080000:0.0:1767320550.946047:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767320550.946056:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320550.946070:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320550.946109:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291980160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320550.946172:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320550.946779:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291980288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320550.953793:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291980288:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320550.954042:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320550.954050:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320550.954054:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320551.201722:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320551.267449:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320552.225491:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320552.289630:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320553.249554:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320553.313503:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320554.274004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320554.337346:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320555.297026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320555.363307:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320556.065077:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320556.065092:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320556.065095:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320556.065100:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320556.065106:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320556.065119:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5455 00000100:00080000:3.0:1767320556.065135:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1767320556.065144:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320556.065160:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320556.065207:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1c00 x1853164291980416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320556.065289:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320556.065297:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320556.065311:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291980544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320556.072700:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320556.072729:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320556.072754:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320556.072760:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291980544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320556.321895:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320556.385235:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320557.345975:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320557.412837:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320558.369920:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320558.433167:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320559.393080:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320559.457506:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320560.417072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320560.483593:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320561.184999:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320561.185016:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320561.185020:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320561.185024:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320561.185030:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320561.185043:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5460 00000100:00080000:2.0:1767320561.185059:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1767320561.185067:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320561.185082:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320561.185127:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291980672/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320561.185201:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291980800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320561.185268:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980672:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320561.188206:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320561.188227:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320561.188244:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291980672:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320561.189991:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291980800:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320561.441022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320561.508580:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320562.465041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320562.529133:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320563.489004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320563.553098:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320564.513799:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320564.577682:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320565.281765:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320540/real 1767320540] req@ffff8c3c5a28ad80 x1853164291979520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320565.281812:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28ad80 x1853164291979520/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320565.281838:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320565.282496:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320565.282505:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291979520:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320565.283141:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320565.283149:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320565.283153:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320565.283160:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5445 00000100:00080000:3.0:1767320565.283173:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320565.283189:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320565.283321:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291980928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320565.283357:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320565.283361:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320565.283363:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320565.283368:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5466 00000100:00080000:3.0:1767320565.283372:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320565.283377:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320565.283390:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320565.283407:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164291981056/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320565.283543:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291981184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320565.285814:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291980928:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320565.285972:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981056:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320565.292556:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320565.292578:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320565.292585:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320565.293023:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291981184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320565.537386:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320565.603965:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320566.561034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320566.627066:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320567.585024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320567.649583:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320568.610151:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320568.673158:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320569.633365:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320569.697307:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320570.402691:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320570.402706:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320570.402709:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320570.402713:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320570.402720:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320570.402772:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5470 00000100:00080000:0.0:1767320570.402789:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320570.402799:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320570.402815:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320570.402866:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291981312/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320570.403067:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320570.408919:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291981440:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320570.425626:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320570.425660:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320570.425667:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320570.428456:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291981440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320570.657118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320570.724674:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320571.681198:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320571.745069:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320572.705072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320572.769628:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320573.729076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320573.795123:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320574.753123:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320574.818461:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320575.521057:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320575.521071:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320575.521075:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320575.521079:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320575.521085:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320575.521100:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5475 00000100:00080000:0.0:1767320575.521117:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320575.521128:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320575.521143:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320575.521191:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291981568/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320575.521543:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320575.521576:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291981696:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320575.530199:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320575.530215:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320575.530220:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320575.530691:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291981696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320575.777031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320575.841621:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320576.802848:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320576.865638:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320577.825060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320577.889144:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320578.849742:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320578.915472:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320579.873066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320579.940741:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320580.641612:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320580.641624:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320580.641627:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320580.641631:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320580.641636:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320580.641646:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5480 00000100:00080000:0.0:1767320580.641657:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320580.641664:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320580.641676:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320580.641711:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291981824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320580.641824:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291981952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320580.642343:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320580.657833:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291981952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320580.667519:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320580.667541:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320580.667547:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291981824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320580.897018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320580.961434:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320581.924148:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320581.985258:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320582.945980:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320583.010964:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320583.969336:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320584.033168:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320584.993736:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320585.057279:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320585.762461:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320585.762476:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320585.762480:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320585.762484:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320585.762490:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320585.762503:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5485 00000100:00080000:2.0:1767320585.762518:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320585.762527:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320585.762543:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320585.762590:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291982080/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320585.762692:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320585.762709:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291982208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320585.763593:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982080:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320585.778490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320585.778516:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320585.778523:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982080:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320585.779516:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291982208:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320586.018768:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320586.088604:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320587.041055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320587.105335:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320588.065073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320588.134108:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320589.089093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320589.156291:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320590.113105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320590.177326:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320590.881143:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320565/real 1767320565] req@ffff8c3c58fc0000 x1853164291980928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320590.881167:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320590.881175:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320590.881179:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1767320590.881191:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0000 x1853164291980928/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320590.881211:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320590.881219:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320590.881227:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5490 00000100:00080000:3.0:1767320590.881232:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320590.881241:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320590.881254:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320590.881269:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:3.0:1767320590.881269:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:3.0:1767320590.881285:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291980928:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320590.881313:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291982336/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320590.881388:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320590.881425:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320590.881427:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320590.881431:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5470 00000100:00080000:0.0:1767320590.881435:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320590.881438:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320590.881452:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291982592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320590.881483:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291982464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320590.882000:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320590.882069:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291982592:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320590.887300:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320590.887323:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320590.887329:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982336:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320590.888318:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291982464:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320591.140071:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320591.201750:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320592.161443:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320592.225348:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320593.185948:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320593.249838:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320594.209325:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320594.273892:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320595.232994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320595.297904:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320596.001080:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320596.001094:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320596.001097:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320596.001101:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320596.001129:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320596.001144:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5495 00000100:00080000:0.0:1767320596.001159:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320596.001168:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320596.001184:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320596.001229:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291982720/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320596.001296:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320596.001393:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320596.001405:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291982848:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320596.006360:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320596.006379:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320596.006395:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320596.006763:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291982848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320596.257205:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320596.321101:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320597.281110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320597.345142:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320598.305222:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320598.369617:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320599.332811:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320599.394576:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320600.353102:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320600.417233:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320601.121041:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320601.121057:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320601.121062:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320601.121067:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320601.121073:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320601.121088:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5500 00000100:00080000:0.0:1767320601.121103:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320601.121112:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320601.121128:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320601.121178:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291982976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320601.121381:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291983104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320601.122215:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982976:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320601.131442:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320601.131469:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320601.131476:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291982976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320601.133766:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291983104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320601.377035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320601.442557:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320602.401035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320602.465644:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320603.425057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320603.489355:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320604.449030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320604.513261:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320605.473024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320605.540301:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320606.241011:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320606.241024:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320606.241027:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320606.241031:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320606.241036:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320606.241048:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5506 00000100:00080000:0.0:1767320606.241062:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320606.241071:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320606.241098:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320606.241148:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291983232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320606.241214:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320606.241230:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291983360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320606.241241:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983232:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320606.246807:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320606.246831:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320606.246838:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320606.250913:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291983360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320606.497027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320606.562483:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320607.521447:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320607.585860:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320608.545040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320608.609223:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320609.569282:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320609.633545:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320610.593105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320610.657178:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320611.361088:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320611.361126:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320611.361129:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320611.361134:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320611.361140:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320611.361155:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5511 00000100:00080000:3.0:1767320611.361169:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320611.361177:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320611.361192:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320611.361268:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164291983488/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320611.361345:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320611.361851:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320611.361906:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291983616:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320611.371522:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320611.371543:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320611.371567:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983488:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320611.371669:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291983616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320611.617069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320611.682505:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320612.641031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320612.705377:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320613.665074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320613.729284:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320614.689188:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320614.753530:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320615.457040:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320590/real 1767320590] req@ffff8c3c50e9ce00 x1853164291982592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320615 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320615.457083:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ce00 x1853164291982592/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320615 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320615.457106:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320615.457140:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320615.457145:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291982592:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320615.458293:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320615.458304:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320615.458309:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320615.458319:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5495 00000100:00080000:2.0:1767320615.458332:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320615.458340:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320615.458387:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291983744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320615.458425:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320615.458429:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320615.458431:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320615.458435:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5516 00000100:00080000:2.0:1767320615.458439:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320615.458463:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320615.458475:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320615.458488:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291983872/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320615.458576:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320615.458597:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291984000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320615.459615:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291983744:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320615.459692:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983872:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320615.465317:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320615.465336:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320615.465342:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291983872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320615.465744:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291984000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320615.713032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320615.777434:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320616.737348:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320616.802584:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320617.761118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320617.825277:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320618.785028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320618.849233:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320619.811700:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320619.873447:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320620.577294:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320620.577308:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320620.577312:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320620.577317:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320620.577323:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320620.577336:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5520 00000100:00080000:0.0:1767320620.577350:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320620.577360:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320620.577402:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320620.577443:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291984128/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320620.577531:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320620.577533:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320620.577546:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291984256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320620.584065:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291984256:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320620.591248:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320620.591271:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320620.591277:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320620.833836:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320620.897342:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320621.858698:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320621.924034:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320622.881441:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320622.945211:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320623.905074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320623.969289:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320624.929770:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320624.994183:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320625.699746:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320625.699761:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320625.699765:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320625.699769:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320625.699775:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320625.699789:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5525 00000100:00080000:0.0:1767320625.699804:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320625.699813:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320625.699828:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320625.699893:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291984384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320625.700022:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320625.701486:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320625.701509:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291984512:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320625.713716:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320625.713744:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320625.713768:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320625.713986:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291984512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320625.953033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320626.017376:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320626.977294:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320627.042644:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320628.001754:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320628.068487:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320629.025019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320629.089239:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320630.051226:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320630.115495:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320630.817661:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320630.817669:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320630.817672:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320630.817675:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320630.817679:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320630.817691:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5530 00000100:00080000:0.0:1767320630.817701:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320630.817709:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320630.817721:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320630.817752:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291984640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320630.818686:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320630.818813:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291984768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320630.825400:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291984768:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320630.825507:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320630.825514:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320630.825518:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320631.073261:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320631.137201:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320632.097039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320632.161192:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320633.121043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320633.185252:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320634.145152:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320634.209154:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320635.169268:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320635.233190:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320635.937050:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320635.937066:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320635.937070:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320635.937075:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320635.937081:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320635.937097:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5535 00000100:00080000:0.0:1767320635.937113:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320635.937122:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320635.937137:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320635.937200:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164291984896/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320635.937538:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291985024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320635.938959:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984896:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320635.944189:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320635.944209:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320635.944215:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291984896:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320635.944809:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291985024:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320636.193354:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320636.257761:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320637.218176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320637.283298:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320638.241180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320638.305719:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320639.265031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320639.329203:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320640.033025:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320615/real 1767320615] req@ffff8c3c5a289c00 x1853164291983744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320640.033075:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289c00 x1853164291983744/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320640.033125:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320640.033151:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320640.033157:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291983744:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320640.033226:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320640.033233:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320640.033237:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320640.033244:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5520 00000100:00080000:0.0:1767320640.033256:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320640.033264:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320640.033307:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164291985152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320640.033333:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320640.033338:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320640.033340:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320640.033344:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5540 00000100:00080000:0.0:1767320640.033348:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320640.033352:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320640.033365:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320640.033378:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164291985280/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320640.033502:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291985408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320640.034083:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291985152:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320640.034129:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320640.042592:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291985408:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767320640.047268:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320640.047287:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320640.047294:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320640.289126:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320640.356910:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320641.313590:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320641.377188:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320642.337086:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320642.401394:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320643.362218:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320643.426381:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320644.385661:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320644.449160:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320645.155023:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320645.155035:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320645.155039:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320645.155043:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320645.155048:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320645.155062:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5544 00000100:00080000:1.0:1767320645.155076:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320645.155084:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320645.155099:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320645.155138:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291985536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320645.155225:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291985664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320645.155570:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985536:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320645.169707:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320645.169728:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320645.169734:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320645.170335:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291985664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320645.409044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320645.473216:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320646.435069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320646.497587:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320647.457021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320647.521452:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320648.481505:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320648.550430:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320649.505057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320649.569082:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320650.273211:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320650.273234:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320650.273238:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320650.273243:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320650.273249:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320650.273262:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5550 00000100:00080000:2.0:1767320650.273275:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320650.273285:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320650.273308:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320650.273354:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291985792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320650.273606:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320650.273616:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291985920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320650.286465:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320650.286488:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320650.286495:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291985792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320650.288591:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291985920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320650.531325:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320650.593093:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320651.553040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320651.618036:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320652.577014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320652.641676:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320653.602963:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320653.665061:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320654.624961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320654.694969:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320655.393859:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320655.393892:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320655.393895:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320655.393898:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320655.393902:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320655.393939:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5555 00000100:00080000:0.0:1767320655.393953:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320655.393962:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320655.393977:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320655.394020:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164291986048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320655.394084:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320655.394096:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291986176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320655.394775:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986048:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320655.413509:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320655.413628:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320655.413634:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320655.414284:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291986176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320655.649072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320655.713142:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320656.673198:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320656.737972:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320657.698616:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320657.761113:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320658.723377:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320658.785742:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320659.745033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320659.809294:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320660.518908:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320660.518923:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320660.518927:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320660.518931:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320660.518937:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320660.518951:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5560 00000100:00080000:2.0:1767320660.518965:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320660.518974:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320660.518989:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320660.519039:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291986304/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320660.519070:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320660.519109:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291986432:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320660.534819:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291986432:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320660.535240:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320660.535259:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320660.535264:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986304:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320660.769034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320660.833489:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320661.794249:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320661.859919:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320662.817030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320662.881143:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320663.841189:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320663.905072:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320664.865411:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320664.929129:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320665.633098:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320640/real 1767320640] req@ffff8c3c50e9ea00 x1853164291985152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320665 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320665.633153:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ea00 x1853164291985152/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320665 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320665.633180:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320665.633208:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320665.633214:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291985152:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320665.635191:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320665.635205:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320665.635210:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320665.635222:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5544 00000100:00080000:2.0:1767320665.635236:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320665.635245:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320665.635296:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291986560/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320665.635333:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320665.635356:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320665.635358:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320665.635362:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5565 00000100:00080000:2.0:1767320665.635366:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320665.635370:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320665.635383:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320665.635396:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291986688/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320665.635467:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320665.635490:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291986816:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320665.635911:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291986560:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320665.635975:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320665.638631:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291986816:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320665.639548:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320665.639561:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320665.639566:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320665.889143:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320665.954476:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320666.914592:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320666.981578:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320667.937075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320668.001388:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320668.961072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320669.025314:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320669.985425:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320670.049130:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320670.754166:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320670.754183:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320670.754186:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320670.754190:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320670.754196:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320670.754208:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5570 00000100:00080000:1.0:1767320670.754223:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320670.754231:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320670.754245:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320670.754297:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2a00 x1853164291986944/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320670.754367:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320670.754391:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291987072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320670.754704:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986944:192.168.202.133@tcp:38:kworker.0 00000100:00080000:3.0:1767320670.758674:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320670.758695:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320670.758702:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291986944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320670.758895:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291987072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320671.009419:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320671.073938:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320672.033082:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320672.097274:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320673.057112:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320673.121287:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320674.081031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320674.164906:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320675.108005:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320675.169126:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320675.873085:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320675.873100:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320675.873103:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320675.873108:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320675.873114:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320675.873128:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5575 00000100:00080000:3.0:1767320675.873143:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320675.873153:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320675.873170:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320675.873221:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164291987200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320675.873318:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320675.873341:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291987328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320675.878387:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320675.878464:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291987328:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320675.882977:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320675.883000:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320675.883008:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320676.129403:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320676.193988:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320677.153040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320677.218058:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320678.177016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320678.241261:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320679.201060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320679.266077:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320680.225066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320680.289403:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320680.993092:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320680.993507:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320680.993510:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320680.993516:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320680.994213:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320680.994230:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5580 00000100:00080000:3.0:1767320680.994278:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320680.994290:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320680.994322:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320680.994424:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164291987456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320680.996300:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320680.999580:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291987584:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320681.002622:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320681.002659:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320681.002666:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320681.005967:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291987584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320681.250026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320681.314559:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320682.273479:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320682.337494:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320683.297050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320683.366865:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320684.321013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320684.385191:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320685.345014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320685.411788:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320686.113275:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320686.113290:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320686.113293:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320686.113298:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320686.113304:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320686.113317:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5585 00000100:00080000:3.0:1767320686.113330:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320686.113339:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320686.113355:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320686.113423:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291987712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320686.113540:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291987840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320686.115144:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987712:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320686.119681:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320686.119702:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320686.119707:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291987712:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320686.119813:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291987840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320686.369240:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320686.433693:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320687.393049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320687.457907:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320688.417023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320688.481109:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320689.441031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320689.506810:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320690.210154:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320665/real 1767320665] req@ffff8c3c5a289180 x1853164291986560/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320690 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320690.210217:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289180 x1853164291986560/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320690 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320690.210243:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320690.210281:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767320690.210286:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291986560:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320690.210359:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320690.210367:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320690.210371:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320690.210378:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5570 00000100:00080000:1.0:1767320690.210391:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320690.210415:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767320690.210466:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291987968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320690.210516:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320690.210521:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320690.210523:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320690.210528:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5591 00000100:00080000:1.0:1767320690.210532:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320690.210538:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320690.210570:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320690.210585:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291988096/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320690.210665:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320690.211003:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291987968:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320690.211132:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320690.211601:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291988224:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320690.223917:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320690.223941:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320690.223948:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320690.224659:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291988224:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320690.465594:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320690.529262:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320691.489021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320691.553537:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320692.514399:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320692.578574:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320693.537240:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320693.603045:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320694.561051:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320694.625142:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320695.329143:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320695.329156:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320695.329159:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320695.329164:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320695.329171:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320695.329185:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5595 00000100:00080000:2.0:1767320695.329200:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320695.329225:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320695.329242:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320695.329282:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291988352/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320695.329362:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320695.329378:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291988480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320695.331512:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988352:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320695.335858:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767320695.335942:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291988480:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320695.340283:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320695.340299:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320695.585044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320695.649335:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320696.609022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320696.675726:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320697.635899:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320697.700508:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320698.657052:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320698.721096:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320699.681094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320699.746652:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320700.452684:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320700.452700:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320700.452703:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320700.452708:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320700.452715:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320700.452728:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5600 00000100:00080000:2.0:1767320700.452742:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320700.452752:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320700.452767:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320700.452813:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164291988608/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320700.454605:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320700.460863:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291988736:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320700.469700:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767320700.469711:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291988736:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320700.469717:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320700.469725:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320700.707552:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320700.769268:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320701.729115:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320701.793429:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320702.753034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320702.817473:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320703.777781:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320703.843132:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320704.801016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320704.865522:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320705.569139:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320705.569152:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320705.569155:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320705.569582:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320705.569587:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320705.569601:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5605 00000100:00080000:0.0:1767320705.569615:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320705.569623:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320705.569640:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320705.569707:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291988864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320705.569781:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320705.571392:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320705.571415:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291988992:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320705.580639:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320705.580662:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320705.580669:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291988864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320705.584675:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291988992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320705.825038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320705.889188:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320706.849631:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320706.917543:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320707.873795:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320707.941540:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320708.898604:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320708.967336:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320709.921293:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320709.985262:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320710.690017:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320710.690033:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320710.690036:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320710.690041:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320710.690046:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320710.690060:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5610 00000100:00080000:3.0:1767320710.690076:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320710.690085:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320710.690100:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320710.690147:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1180 x1853164291989120/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320710.690237:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320710.690254:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291989248:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320710.692143:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320710.694018:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291989248:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320710.701316:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320710.701338:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320710.701345:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989120:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320710.945292:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320711.009169:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320711.969042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320712.034677:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320712.993025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320713.058554:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320714.017031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320714.081531:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320715.041597:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320715.114333:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320715.808997:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320690/real 1767320690] req@ffff8c3c46ab3b80 x1853164291987968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320715.809044:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3b80 x1853164291987968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320715.809068:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320715.809099:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320715.809104:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291987968:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320715.809202:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320715.809209:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320715.809213:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320715.809220:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5595 00000100:00080000:0.0:1767320715.809233:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320715.809241:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320715.809293:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291989376/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320715.809321:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320715.809324:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320715.809326:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320715.809330:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5615 00000100:00080000:0.0:1767320715.809334:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320715.809338:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320715.809369:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320715.809385:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291989504/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320715.809654:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291989376:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320715.809773:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320715.810015:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291989632:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320715.818169:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320715.818192:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320715.818199:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320715.820364:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291989632:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320716.065482:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320716.129601:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320717.089065:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320717.154037:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320718.113043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320718.179754:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320719.138586:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320719.201416:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320720.162499:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320720.225380:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320720.929256:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320720.929271:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320720.929275:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320720.929280:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320720.929287:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320720.929300:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5620 00000100:00080000:1.0:1767320720.929315:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320720.929324:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320720.929341:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320720.929391:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3b80 x1853164291989760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320720.929473:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291989888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320720.930090:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320720.957087:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291989888:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320720.957471:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320720.957480:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320720.957485:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291989760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320721.185027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320721.249571:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320722.210128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320722.273119:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320723.233047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320723.297169:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320724.259056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320724.322643:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320725.281001:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320725.345156:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320726.049142:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320726.049167:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320726.049171:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320726.049176:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320726.049182:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320726.049197:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5625 00000100:00080000:0.0:1767320726.049213:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320726.049224:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320726.049238:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320726.049286:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291990016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320726.049382:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291990144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320726.050058:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320726.054059:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291990144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320726.055684:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320726.055704:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320726.055712:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320726.305201:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320726.375599:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320727.331263:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320727.393819:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320728.354482:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320728.417265:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320729.377238:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320729.444632:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320730.401045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320730.465258:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320731.169020:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320731.169033:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320731.169037:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320731.169042:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320731.169049:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320731.169061:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5630 00000100:00080000:0.0:1767320731.169076:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320731.169084:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320731.169099:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320731.169157:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291990272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320731.169232:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320731.169253:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291990400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320731.171708:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320731.173662:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291990400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320731.182190:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320731.182212:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320731.182218:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320731.425095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320731.489283:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320732.453164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320732.513159:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320733.473277:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320733.537583:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320734.499913:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320734.561127:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320735.521089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320735.585807:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320736.289830:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320736.289844:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320736.289847:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320736.289851:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320736.289857:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320736.289868:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5636 00000100:00080000:2.0:1767320736.289899:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320736.289906:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320736.289921:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320736.289959:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291990528/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320736.290036:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320736.290053:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291990656:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320736.290118:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320736.303469:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291990656:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320736.310138:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320736.310159:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320736.310165:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990528:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320736.545014:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320736.610768:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320737.569004:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320737.634010:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320738.593771:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320738.657251:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320739.617050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320739.682603:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320740.385062:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320715/real 1767320715] req@ffff8c3c50e9ed80 x1853164291989376/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320740.385110:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ed80 x1853164291989376/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320740.385135:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320740.385161:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320740.385166:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291989376:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320740.387847:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320740.387861:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320740.387866:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320740.387999:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5620 00000100:00080000:0.0:1767320740.388013:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320740.388021:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320740.388076:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291990784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320740.388134:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320740.388138:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320740.388140:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320740.388144:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5641 00000100:00080000:0.0:1767320740.388148:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320740.388152:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320740.388165:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320740.388178:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291990912/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320740.388245:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291991040:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320740.388668:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291990784:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320740.394117:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320740.405819:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291991040:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320740.408542:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320740.408575:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320740.408582:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291990912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320740.641038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320740.707510:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320741.665076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320741.729288:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320742.689046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320742.760835:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320743.713072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320743.777716:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320744.737036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320744.801127:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320745.505793:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320745.505804:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320745.505808:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320745.505813:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320745.505818:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320745.505830:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5645 00000100:00080000:2.0:1767320745.505850:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320745.505860:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320745.505909:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320745.505951:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291991168/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320745.506042:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291991296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320745.506075:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320745.519627:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291991296:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320745.522628:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320745.522661:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320745.522668:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320745.763811:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320745.825217:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320746.785520:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320746.849315:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320747.809011:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320747.873722:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320748.833048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320748.900429:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320749.857072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320749.921899:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320750.625705:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320750.625722:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320750.625725:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320750.625730:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320750.625761:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320750.625775:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5650 00000100:00080000:2.0:1767320750.625791:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320750.625802:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320750.625820:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320750.625890:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164291991424/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320750.625990:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320750.626007:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291991552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320750.626186:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991424:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320750.633656:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320750.633677:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320750.633683:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320750.634776:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291991552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320750.883751:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320750.946448:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320751.905092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320751.969339:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320752.929047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320752.995452:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320753.954718:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320754.017430:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320754.977228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320755.041105:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320755.745231:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320755.745271:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320755.745274:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320755.745279:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320755.745285:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320755.745298:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5655 00000100:00080000:0.0:1767320755.745314:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320755.745324:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320755.745339:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320755.745387:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291991680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320755.745471:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320755.745495:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291991808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320755.745914:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991680:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320755.750391:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320755.750412:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320755.750418:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320755.755561:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291991808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320756.000992:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320756.065121:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320757.025176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320757.092523:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320758.049095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320758.113125:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320759.073044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320759.137369:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320760.097030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320760.161572:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320760.867353:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320760.867370:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320760.867373:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320760.867377:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320760.867383:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320760.867397:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5660 00000100:00080000:2.0:1767320760.867411:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320760.867420:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320760.867434:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320760.867480:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291991936/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320760.867727:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320760.867971:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291992064:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320760.871187:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291992064:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320760.876582:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320760.876606:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320760.876612:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291991936:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320761.121026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320761.185486:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320762.145206:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320762.212462:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320763.169319:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320763.233398:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320764.193084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320764.258670:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320765.217109:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320765.281200:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320765.985238:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320765.985248:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320765.985251:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320765.985254:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320765.985259:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320765.985269:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5665 00000100:00080000:3.0:1767320765.985280:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320765.985287:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320765.985300:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320765.985339:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3b80 x1853164291992192/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320765.985446:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320765.985465:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291992320:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320765.991090:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320740/real 1767320740] req@ffff8c3c50e9dc00 x1853164291990784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320765.991136:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9dc00 x1853164291990784/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320765.991170:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320765.991195:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291992320:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320765.991295:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320765.991323:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320765.991340:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291990784:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320765.991402:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320765.991411:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320765.991415:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320765.991422:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5645 00000100:00080000:3.0:1767320765.991429:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320765.991438:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320765.991481:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2680 x1853164291992448/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320765.991742:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291992448:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767320765.993157:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320765.993171:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320765.993176:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992192:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320766.241032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320766.305166:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320767.265026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320767.329190:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320768.289095:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320768.355712:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320769.313761:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320769.377067:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320770.337040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320770.401735:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320771.105562:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320771.105576:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320771.105579:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320771.105584:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320771.105589:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320771.105602:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5670 00000100:00080000:1.0:1767320771.106284:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320771.106318:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320771.106332:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320771.106372:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0700 x1853164291992576/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320771.106536:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320771.106730:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320771.106742:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291992704:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320771.111183:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291992704:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320771.111301:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320771.111316:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320771.111322:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320771.361124:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320771.427983:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320772.385624:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320772.449176:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320773.409524:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320773.479141:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320774.113025:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320774.113040:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320774.113044:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320774.113048:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320774.113054:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320774.113066:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5676 00000100:00080000:1.0:1767320774.113080:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320774.113090:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320774.113105:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320774.113152:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0380 x1853164291992832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320774.113248:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320774.113272:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291992960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320774.113538:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320774.123525:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291992960:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320774.123775:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320774.123784:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320774.123796:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291992832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320774.433058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320774.497372:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320775.458581:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320775.521346:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320776.481289:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320776.545103:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320777.509097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320777.571351:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320778.529235:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320778.594083:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320779.297131:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320779.297146:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320779.297150:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320779.297154:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320779.297160:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320779.297174:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5679 00000100:00080000:0.0:1767320779.297189:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320779.297198:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320779.297246:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320779.297284:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9df80 x1853164291993088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320779.297357:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320779.297378:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291993216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320779.297401:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320779.308863:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291993216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320779.308918:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320779.308928:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320779.308934:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320779.553007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320779.619373:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320780.579037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320780.643125:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320781.603895:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320781.665135:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320782.625239:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320782.691607:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320783.649180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320783.713163:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320784.417918:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320784.417927:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320784.417930:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320784.417934:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320784.417938:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320784.418075:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5684 00000100:00080000:2.0:1767320784.418089:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320784.418096:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320784.418109:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320784.418144:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164291993344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320784.418445:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291993472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320784.428335:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320784.429247:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291993472:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320784.435216:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320784.435232:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320784.435237:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320784.673174:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320784.737220:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320785.697026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320785.761213:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320786.721415:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320786.785638:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320787.745212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320787.809190:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320788.769007:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320788.833396:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320789.543639:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320789.543654:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320789.543657:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320789.543661:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320789.543667:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320789.543680:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5689 00000100:00080000:0.0:1767320789.543694:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320789.543702:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320789.543717:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320789.543762:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291993600/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320789.543858:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291993728:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320789.544179:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320789.550959:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291993728:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320789.555676:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320789.555696:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320789.555703:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993600:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320789.793329:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320789.857162:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320790.563023:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320765/real 1767320765] req@ffff8c3c58fc2680 x1853164291992448/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320790 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320790.563096:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2680 x1853164291992448/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320790 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320790.563120:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320790.563151:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320790.563156:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291992448:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320790.563257:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320790.563264:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320790.563275:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320790.563281:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5670 00000100:00080000:0.0:1767320790.563293:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320790.563302:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320790.563340:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f100 x1853164291993856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320790.563403:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291993856:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320790.563541:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320790.563545:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320790.563548:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320790.563552:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5694 00000100:00080000:0.0:1767320790.563557:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320790.563562:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320790.563599:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320790.563615:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291993984/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320790.571959:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320790.574096:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291994112:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320790.579212:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320790.579239:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320790.579246:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291993984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320790.579742:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291994112:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320790.817602:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320790.881178:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320791.841042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320791.905249:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320792.865059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320792.929305:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320793.889862:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320793.955581:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320794.915384:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320794.977178:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320795.681766:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320795.681778:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320795.681781:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320795.681785:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320795.681790:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320795.681803:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5695 00000100:00080000:2.0:1767320795.681819:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320795.681827:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320795.681844:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320795.681918:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164291994240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320795.681998:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291994368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320795.682328:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320795.684293:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291994368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320795.686655:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320795.686676:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320795.686682:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320795.937028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320796.001231:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320796.961125:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320797.025484:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320797.985029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320798.049150:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320799.009010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320799.074160:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320800.033022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320800.097918:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320800.804770:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320800.804786:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320800.804790:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320800.804794:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320800.804800:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320800.804815:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5700 00000100:00080000:0.0:1767320800.804848:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320800.804858:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320800.804898:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320800.804942:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f480 x1853164291994496/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320800.805017:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291994624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320800.808766:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320800.820294:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291994624:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320800.820418:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320800.820426:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320800.820431:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320801.059089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320801.122405:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320802.081115:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320802.145266:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320803.109803:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320803.169424:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320804.129987:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320804.193082:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320805.154154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320805.217284:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320805.921064:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320805.921079:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320805.921083:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320805.921087:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320805.921093:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320805.921108:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5705 00000100:00080000:2.0:1767320805.921123:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320805.921131:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320805.921176:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320805.921216:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291994752/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320805.921273:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320805.921631:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291994880:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767320805.924867:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320805.924924:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767320805.924930:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291994752:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320805.928990:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291994880:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320806.178301:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320806.245046:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320807.201037:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320807.265568:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320808.225035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320808.290750:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320809.249024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320809.313218:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320810.273096:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320810.337181:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320811.041423:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320811.041437:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320811.041441:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320811.041446:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320811.041452:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320811.041467:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5710 00000100:00080000:1.0:1767320811.041480:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320811.041490:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320811.041589:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320811.041639:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291995008/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320811.042025:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320811.042429:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291995136:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320811.048626:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320811.048646:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320811.048727:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995008:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320811.049250:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291995136:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320811.297192:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320811.361997:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320812.321101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320812.387428:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320813.346320:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320813.409151:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320814.369735:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320814.433159:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320815.137046:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320790/real 1767320790] req@ffff8c3c50e9f100 x1853164291993856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320815 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320815.137092:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f100 x1853164291993856/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320815 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320815.137112:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320815.137193:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320815.137198:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291993856:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320815.137811:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320815.137817:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320815.137820:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320815.137825:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5695 00000100:00080000:0.0:1767320815.137833:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320815.137839:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320815.137899:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9f800 x1853164291995264/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320815.137967:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291995264:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320815.138121:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320815.138125:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320815.138127:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320815.138131:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5715 00000100:00080000:0.0:1767320815.138136:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320815.138156:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320815.138165:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320815.138178:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ca80 x1853164291995392/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320815.138723:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320815.139914:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291995520:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320815.141481:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320815.141493:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320815.141499:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320815.145445:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291995520:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320815.393180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320815.457432:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320816.417018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320816.481343:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320817.441074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320817.505357:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320818.466828:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320818.529155:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320819.489185:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320819.553529:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320820.257013:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320820.257027:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320820.257030:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320820.257034:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320820.257039:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320820.257052:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5720 00000100:00080000:1.0:1767320820.257077:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320820.257086:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320820.257101:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320820.257148:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1f80 x1853164291995648/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320820.257215:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320820.257229:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291995776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320820.257910:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320820.260455:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291995776:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320820.262077:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320820.262094:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320820.262100:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320820.515016:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320820.577336:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320821.540492:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320821.601311:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320822.561165:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320822.625245:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320823.585244:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320823.649998:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320824.609063:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320824.673083:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320825.378401:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320825.378550:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320825.378554:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320825.378559:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320825.378566:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320825.378581:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5725 00000100:00080000:0.0:1767320825.378598:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320825.378607:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320825.378622:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320825.379136:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9dc00 x1853164291995904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320825.379563:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320825.380088:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320825.393965:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320825.393998:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320825.394004:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291995904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320825.403448:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320825.633105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320825.698124:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320826.657389:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320826.721332:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320827.681734:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320827.747836:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320828.707449:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320828.769617:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320829.729025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320829.793220:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320830.497021:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320830.497035:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320830.497038:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320830.497042:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320830.497048:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320830.497062:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5730 00000100:00080000:0.0:1767320830.497077:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320830.497087:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320830.497101:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320830.497148:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9fb80 x1853164291996160/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320830.497277:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320830.497302:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996288:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320830.497998:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320830.507714:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996288:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320830.507847:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320830.507856:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320830.507860:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996160:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320830.753271:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320830.817087:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320831.777098:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320831.841241:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320832.801092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320832.865277:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320833.825026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320833.890412:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320834.850282:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320834.918239:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320835.617015:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320835.617033:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320835.617037:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320835.617041:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320835.617048:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320835.617061:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5735 00000100:00080000:0.0:1767320835.617076:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320835.617086:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320835.617123:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320835.617180:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d880 x1853164291996416/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320835.617284:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996544:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320835.617560:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320835.621529:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291996544:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320835.629909:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320835.630779:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320835.630789:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996416:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320835.873587:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320835.937200:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320836.897783:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320836.965310:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320837.921021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320837.986947:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320838.945214:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320839.009284:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320839.969062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320840.033108:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320840.738848:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320815/real 1767320815] req@ffff8c3c50e9f800 x1853164291995264/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320840.738925:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9f800 x1853164291995264/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320840 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320840.738950:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320840.739001:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320840.739006:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291995264:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320840.741103:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320840.741127:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320840.741132:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320840.741143:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5720 00000100:00080000:2.0:1767320840.741157:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320840.741166:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320840.741215:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164291996672/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320840.741249:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320840.741253:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320840.741255:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320840.741259:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5740 00000100:00080000:2.0:1767320840.741278:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320840.741283:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320840.741294:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320840.741308:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164291996800/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320840.741383:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320840.741404:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291996928:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320840.741622:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291996672:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320840.741665:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996800:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320840.751079:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320840.751101:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320840.751108:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291996800:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320840.751646:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291996928:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320840.993042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320841.057659:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320842.017091:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320842.083197:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320843.041017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320843.105261:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320844.065026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320844.129798:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320845.089038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320845.153504:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320845.857082:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320845.857097:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320845.857100:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320845.857105:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320845.857112:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320845.857126:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5745 00000100:00080000:2.0:1767320845.857144:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320845.857156:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320845.857172:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320845.857220:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164291997056/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320845.857343:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291997184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320845.857831:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320845.866137:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291997184:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320845.868766:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320845.868782:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320845.868788:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320846.115662:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320846.177172:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320847.137026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320847.201436:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320848.161274:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320848.225913:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320849.185289:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320849.249207:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320850.209974:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320850.276325:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320850.977709:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320850.977720:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320850.977723:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320850.977727:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320850.977731:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320850.977741:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5750 00000100:00080000:0.0:1767320850.977752:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320850.977772:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320850.977784:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320850.977830:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ed80 x1853164291997312/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320850.977954:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291997440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320850.978296:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997312:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320850.991471:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320850.991487:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320850.991493:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997312:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320850.992485:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291997440:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320851.237228:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320851.311086:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320852.257452:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320852.321089:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320853.281024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320853.347384:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320854.306123:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767320854.369420:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320855.332750:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320855.393164:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320856.097164:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320856.097174:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320856.097178:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320856.097182:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320856.097186:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320856.097197:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5755 00000100:00080000:3.0:1767320856.097207:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320856.097214:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320856.097226:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320856.097262:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1880 x1853164291997568/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320856.097333:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291997696:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320856.097550:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320856.115351:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291997696:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320856.120446:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320856.120540:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320856.120547:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997568:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320856.353044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320856.417173:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320857.377778:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320857.441587:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320858.401036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320858.467036:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320859.432013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320859.489992:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320860.449038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320860.513372:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320861.219164:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320861.219174:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320861.219177:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320861.219180:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320861.219184:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320861.219194:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5760 00000100:00080000:2.0:1767320861.219205:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320861.219212:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320861.219223:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320861.219257:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164291997824/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320861.219337:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320861.219353:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291997952:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320861.219717:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320861.232147:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291997952:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320861.232911:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320861.232921:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320861.232934:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291997824:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320861.473059:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320861.537186:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320862.497036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320862.561279:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320863.521922:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:3.0:1767320863.585551:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320864.545073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320864.610614:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320865.313072:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320840/real 1767320840] req@ffff8c3c5a289880 x1853164291996672/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320865 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320865.313106:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289880 x1853164291996672/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320865 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320865.313124:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320865.313150:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320865.313155:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291996672:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320865.320723:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320865.320734:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320865.320738:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320865.320752:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5745 00000100:00080000:0.0:1767320865.320764:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320865.320771:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320865.320817:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9d180 x1853164291998080/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320865.320853:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320865.320857:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320865.320859:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320865.320863:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5766 00000100:00080000:0.0:1767320865.320866:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320865.320911:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320865.320922:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320865.320933:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c380 x1853164291998208/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320865.321008:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291998336:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320865.321009:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291998080:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320865.321316:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998208:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320865.327933:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291998336:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320865.330032:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320865.330047:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320865.330052:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998208:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320865.569964:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320865.634021:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320866.593440:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320866.657359:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320867.617118:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320867.681640:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320868.643209:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320868.711502:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320869.664998:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320869.729383:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320870.432996:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320870.433007:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320870.433009:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320870.433012:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320870.433025:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320870.433034:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5770 00000100:00080000:0.0:1767320870.433044:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320870.433051:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320870.433062:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320870.433111:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c000 x1853164291998464/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320870.433192:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291998592:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320870.434475:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998464:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320870.445639:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164291998592:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320870.456860:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320870.456895:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320870.456902:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998464:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320870.689459:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320870.753547:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320871.713107:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320871.777486:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320872.737040:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320872.801106:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320873.761523:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320873.825768:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320874.785031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320874.850029:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320875.553651:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320875.553661:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320875.553664:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320875.553670:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320875.553675:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320875.553686:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5775 00000100:00080000:2.0:1767320875.553698:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320875.553705:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320875.553740:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320875.553777:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164291998720/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320875.553907:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291998848:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320875.554632:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320875.565738:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164291998848:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320875.565855:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320875.565863:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320875.565867:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998720:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320875.809036:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320875.874042:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320876.833017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320876.897316:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320877.857105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320877.923709:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320878.881940:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320878.946042:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320879.906464:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320879.970961:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320880.673681:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320880.673690:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320880.673693:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320880.673706:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320880.673710:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320880.673720:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5780 00000100:00080000:0.0:1767320880.673731:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320880.673737:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320880.673793:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320880.673823:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e300 x1853164291998976/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320880.673921:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291999104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320880.674494:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998976:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320880.681524:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320880.681541:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320880.681547:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291998976:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320880.681657:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164291999104:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320880.929390:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320880.998249:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320881.958510:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320882.017620:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320882.977928:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320883.041543:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320884.004161:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320884.065210:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320885.025398:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320885.092562:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320885.793819:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320885.793831:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320885.793835:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320885.793839:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320885.793844:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320885.794315:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5785 00000100:00080000:2.0:1767320885.794331:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320885.794342:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320885.794358:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320885.794419:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164291999232/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320885.794541:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291999360:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320885.797030:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320885.820846:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291999360:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320885.821053:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320885.821060:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320885.821064:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999232:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320886.049090:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320886.114853:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320887.073019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320887.137165:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320888.097025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320888.161155:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320889.122089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320889.185136:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320890.145110:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320890.209461:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320890.912997:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320865/real 1767320865] req@ffff8c3c50e9d180 x1853164291998080/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320890.913030:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9d180 x1853164291998080/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320890.913049:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320890.913073:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320890.913095:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291998080:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320890.913182:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320890.913188:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320890.913192:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320890.913197:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5770 00000100:00080000:2.0:1767320890.913205:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320890.913236:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320890.913266:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b800 x1853164291999488/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320890.913302:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320890.913305:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320890.913307:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320890.913310:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5790 00000100:00080000:2.0:1767320890.913315:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320890.913319:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320890.913329:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320890.913340:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164291999616/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320890.913380:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320890.913405:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291999744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320890.913448:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291999488:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320890.913491:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999616:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320890.922020:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164291999744:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320890.922206:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320890.922214:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320890.922218:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999616:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320891.171439:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320891.233258:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320892.194464:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320892.257303:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320893.217039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320893.281184:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320894.241050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320894.305830:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320895.266385:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320895.329358:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320896.033763:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320896.033774:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320896.033827:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320896.033831:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320896.033836:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320896.033846:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5795 00000100:00080000:2.0:1767320896.033857:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320896.033865:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320896.033905:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320896.033940:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289180 x1853164291999872/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320896.034271:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320896.034287:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292000000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320896.034731:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320896.073829:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292000000:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320896.076664:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320896.076678:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320896.076684:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164291999872:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320896.290919:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320896.353247:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320897.314322:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320897.381170:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320898.337044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320898.401271:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320899.361197:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320899.425476:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320900.385021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320900.449916:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320901.153103:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320901.153118:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320901.153156:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320901.153161:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320901.153167:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320901.153181:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5800 00000100:00080000:3.0:1767320901.153196:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320901.153206:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320901.153223:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320901.153280:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164292000128/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320901.153357:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320901.153379:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292000256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320901.155112:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000128:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767320901.161361:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320901.161383:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320901.161390:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000128:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320901.162851:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292000256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320901.413013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320901.473158:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320902.434077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320902.497300:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320903.457425:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320903.521065:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320904.484759:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320904.546571:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320905.509997:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320905.569150:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320906.273233:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320906.273249:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320906.273253:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320906.273258:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320906.273263:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320906.273281:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5806 00000100:00080000:1.0:1767320906.273299:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320906.273310:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320906.273325:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320906.273381:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3800 x1853164292000384/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320906.273467:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292000512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320906.273730:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000384:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320906.279230:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320906.279254:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320906.279261:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000384:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320906.279381:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292000512:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320906.529022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320906.597149:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320907.553961:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320907.617533:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320908.577108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320908.641139:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320909.601114:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320909.665143:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320910.625205:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320910.691179:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320911.393413:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320911.393427:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320911.393431:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320911.393435:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320911.393463:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320911.393493:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5811 00000100:00080000:3.0:1767320911.393509:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320911.393518:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320911.393535:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320911.393596:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164292000640/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320911.393675:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320911.393775:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320911.394180:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292000768:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320911.397547:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320911.397563:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767320911.397565:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292000768:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320911.397568:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292000640:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320911.649178:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320911.713618:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320912.674479:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320912.741209:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320913.699621:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320913.771710:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320914.722097:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320914.788808:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320915.489080:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320890/real 1767320890] req@ffff8c3c5a28b800 x1853164291999488/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320915.489121:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b800 x1853164291999488/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320915.489144:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320915.489170:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320915.489175:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164291999488:192.168.202.133@tcp:250:kworker.0 00000100:00080000:0.0:1767320915.489317:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320915.489327:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320915.489332:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320915.489342:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5795 00000100:00080000:0.0:1767320915.489352:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320915.489359:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:0.0:1767320915.489409:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ea00 x1853164292000896/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320915.489454:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320915.489458:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320915.489459:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320915.489464:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5816 00000100:00080000:0.0:1767320915.489468:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320915.489491:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320915.489501:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320915.489514:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164292001024/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320915.489710:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292001152:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320915.489896:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292000896:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320915.489940:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001024:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320915.494624:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320915.494647:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320915.494655:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001024:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320915.495787:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292001152:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320915.745101:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320915.809771:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320916.769035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320916.835806:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320917.793003:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320917.857372:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320918.817010:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320918.881260:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320919.841358:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320919.906261:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320920.609150:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320920.609161:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320920.609164:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320920.609168:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320920.609172:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320920.609182:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5820 00000100:00080000:3.0:1767320920.609192:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320920.609200:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320920.609232:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320920.609263:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164292001280/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320920.609512:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320920.609980:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292001408:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320920.615928:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320920.615956:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320920.615962:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001280:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320920.616575:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292001408:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320920.865231:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320920.930153:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320921.889092:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320921.953898:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320922.913019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320922.977185:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320923.937030:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320924.001178:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320924.961984:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320925.025621:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320925.729295:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320925.729306:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320925.729309:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320925.729313:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320925.729318:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320925.729329:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5825 00000100:00080000:1.0:1767320925.729351:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320925.729359:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320925.729371:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320925.729406:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1c00 x1853164292001536/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320925.729431:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320925.729463:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292001664:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320925.740630:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320925.740646:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320925.740652:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001536:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320925.749382:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292001664:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320925.986074:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320926.050856:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320927.009039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320927.073675:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320928.035473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320928.097145:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320929.057911:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320929.121213:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320930.081033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320930.145350:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320930.852498:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320930.852509:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320930.852512:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320930.852516:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320930.852520:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320930.852531:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5830 00000100:00080000:0.0:1767320930.852563:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320930.852570:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320930.852582:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320930.852620:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164292001792/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320930.852694:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292001920:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320930.853188:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320930.856967:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292001920:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320930.857120:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320930.857128:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320930.857132:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292001792:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320931.106415:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320931.176741:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320932.129026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320932.194228:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320933.153021:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320933.219689:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320934.177292:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320934.241489:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320935.201028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320935.265225:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320935.969024:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320935.969036:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320935.969039:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320935.969043:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320935.969047:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320935.969057:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5835 00000100:00080000:0.0:1767320935.969068:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320935.969075:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767320935.969088:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320935.969123:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9e680 x1853164292002048/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320935.969203:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292002176:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320935.969335:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767320935.974304:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292002176:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320935.978949:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320935.978980:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320935.978986:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002048:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320936.225027:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320936.292863:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320937.249039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320937.313982:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320938.274362:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320938.337558:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320939.297192:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320939.361264:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320940.065663:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320915/real 1767320915] req@ffff8c3c50e9ea00 x1853164292000896/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320940 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320940.065695:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c50e9ea00 x1853164292000896/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320940 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320940.065714:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320940.065743:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767320940.065747:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292000896:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767320940.065837:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320940.065842:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320940.065845:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320940.065850:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5820 00000100:00080000:2.0:1767320940.065859:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320940.065864:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320940.065914:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28b100 x1853164292002304/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320940.065951:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320940.065955:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320940.065957:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320940.065961:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5840 00000100:00080000:2.0:1767320940.065964:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320940.065968:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320940.065976:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320940.065985:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288380 x1853164292002432/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320940.066036:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320940.066047:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292002560:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320940.066335:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292002304:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767320940.066413:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002432:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320940.071415:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292002560:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320940.075767:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320940.075784:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320940.076136:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002432:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320940.321952:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320940.385445:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320941.345146:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320941.410057:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320942.369217:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320942.433176:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320943.393046:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320943.457729:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320944.417565:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320944.481271:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320945.185031:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320945.185041:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320945.185044:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320945.185048:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320945.185052:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320945.185064:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5844 00000100:00080000:2.0:1767320945.185075:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320945.185082:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320945.185094:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320945.185171:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164292002688/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320945.185473:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292002816:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320945.188319:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320945.191273:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292002816:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320945.195257:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320945.195329:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320945.195335:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002688:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320945.441009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320945.505041:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320946.465019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320946.529444:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320947.489099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320947.553739:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320948.513028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320948.577534:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320949.537696:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320949.601359:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320950.305449:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320950.305464:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320950.305468:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320950.305540:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320950.305545:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320950.305557:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5850 00000100:00080000:3.0:1767320950.305570:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320950.305577:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320950.305588:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320950.305626:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164292002944/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320950.305695:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320950.307565:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320950.307587:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292003072:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320950.315516:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292003072:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320950.316238:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320950.316247:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320950.316252:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292002944:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320950.561265:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320950.625204:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320951.585186:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320951.649698:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320952.609019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320952.676825:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320953.633475:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320953.702452:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320954.657008:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320954.722605:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320955.430399:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320955.430411:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320955.430413:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320955.430417:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320955.430422:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320955.430433:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5855 00000100:00080000:2.0:1767320955.430444:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320955.430450:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320955.430463:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320955.430502:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164292003200/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320955.430577:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320955.430595:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292003328:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767320955.430853:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320955.434093:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292003328:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320955.436989:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320955.437012:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320955.437018:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003200:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320955.681022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320955.751374:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320956.705789:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320956.773122:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320957.729716:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320957.794414:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320958.753128:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320958.819294:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320959.777180:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320959.856258:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320960.545056:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320960.545071:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320960.545074:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320960.545078:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320960.545083:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320960.545095:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5860 00000100:00080000:1.0:1767320960.545108:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320960.545116:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320960.545130:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320960.546174:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab0a80 x1853164292003456/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320960.546262:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292003584:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320960.552178:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320960.559685:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292003584:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320960.559899:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320960.559907:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320960.559912:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003456:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320960.801049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320960.865523:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320961.826035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320961.889265:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320962.849035:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320962.914461:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320963.874424:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320963.937601:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320964.897045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320964.967842:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320965.665038:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320965.665053:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320965.665056:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320965.665061:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320965.665067:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320965.665081:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5865 00000100:00080000:1.0:1767320965.665096:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320965.665105:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320965.665121:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320965.665187:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164292003712/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320965.665287:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292003840:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320965.666012:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320940/real 1767320940] req@ffff8c3c5a28b100 x1853164292002304/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320965 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320965.666039:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a28b100 x1853164292002304/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320965 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320965.666055:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003712:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320965.666116:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320965.666127:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320965.666132:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292002304:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320965.670275:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292003840:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320965.671691:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320965.671706:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320965.671711:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292003712:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767320965.673042:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320965.673055:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320965.673060:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320965.673070:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5844 00000100:00080000:2.0:1767320965.673081:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320965.673090:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767320965.673137:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164292003968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320965.673462:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292003968:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767320965.925988:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320965.985273:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320966.949154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320967.013178:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320967.969018:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320968.033342:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320968.994400:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320969.058761:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320970.017163:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320970.081291:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320970.785399:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320970.785411:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320970.785413:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320970.785417:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320970.785421:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320970.785431:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5870 00000100:00080000:2.0:1767320970.785444:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320970.785451:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320970.785463:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320970.785510:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288a80 x1853164292004096/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320970.785673:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320970.785861:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292004224:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320970.792914:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292004224:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767320970.796190:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320970.796210:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767320970.796216:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004096:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320971.041049:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320971.105293:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320972.065060:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320972.131229:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320973.089955:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320973.158551:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320974.113048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320974.177098:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320975.137039:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320975.201160:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320975.905505:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320975.905515:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320975.905539:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320975.905544:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320975.905548:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320975.905559:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5875 00000100:00080000:2.0:1767320975.905571:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320975.905578:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320975.905590:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320975.905623:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164292004352/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320975.905711:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320975.905712:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320975.905721:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292004480:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320975.923768:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320975.923785:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320975.923791:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004352:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320975.924063:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292004480:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320976.161029:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320976.225216:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320977.185045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320977.249968:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320978.210276:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320978.276361:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320979.233089:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320979.298363:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320980.257069:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320980.322459:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320981.030424:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320981.030436:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320981.030439:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320981.030442:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320981.030447:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320981.030457:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5880 00000100:00080000:3.0:1767320981.030467:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320981.030474:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320981.030486:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320981.030519:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3100 x1853164292004608/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320981.030606:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320981.030624:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292004736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320981.031403:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004608:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320981.038956:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320981.038975:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320981.038981:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004608:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320981.039011:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292004736:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767320981.281023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320981.345261:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320982.309766:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320982.370005:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320983.329038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320983.395777:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320984.353194:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320984.417440:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320985.377064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320985.443331:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320986.146045:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320986.146058:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320986.146062:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320986.146066:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320986.146070:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320986.146081:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5885 00000100:00080000:1.0:1767320986.146093:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320986.146101:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767320986.146134:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320986.146164:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164292004864/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320986.146246:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292004992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320986.146426:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004864:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767320986.160177:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320986.160194:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320986.160199:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292004864:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767320986.165978:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292004992:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320986.402015:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320986.465143:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320987.425009:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320987.489515:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320988.449481:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320988.513253:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320989.473176:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320989.537141:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320990.241507:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320965/real 1767320965] req@ffff8c3c5a289880 x1853164292003968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320990 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320990.241553:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289880 x1853164292003968/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320990 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320990.241573:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320990.241803:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767320990.241808:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292003968:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767320990.245968:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320990.245978:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320990.245983:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320990.245993:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5870 00000100:00080000:3.0:1767320990.246002:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320990.246009:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767320990.246048:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164292005120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320990.246085:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320990.246089:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320990.246091:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320990.246094:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5891 00000100:00080000:3.0:1767320990.246098:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320990.246101:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767320990.246111:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320990.246122:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164292005248/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320990.247945:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292005120:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767320990.248080:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005248:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320990.248787:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005376:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320990.254834:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320990.254850:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320990.254855:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005248:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320990.259861:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005376:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767320990.500167:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320990.561092:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320991.521195:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320991.587669:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320992.545523:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320992.609535:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320993.569061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320993.634323:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320994.593154:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320994.657554:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320995.361050:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320995.361060:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320995.361086:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320995.361090:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320995.361094:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320995.361112:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5895 00000100:00080000:2.0:1767320995.361123:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320995.361130:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767320995.361143:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320995.361173:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a300 x1853164292005504/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320995.361247:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320995.361259:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005632:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767320995.361720:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767320995.364938:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005632:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767320995.370925:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320995.370943:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767320995.370948:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005504:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767320995.617161:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320995.681349:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320996.641175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320996.705256:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320997.665019:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320997.731181:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320998.689057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320998.753299:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320999.713094:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767320999.779614:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767321000.481768:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321000.481780:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767321000.481783:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321000.481787:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321000.481792:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321000.481802:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5900 00000100:00080000:2.0:1767321000.481815:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321000.481823:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321000.481835:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321000.481890:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28a680 x1853164292005760/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321000.482081:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767321000.482456:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005760:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767321000.489490:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767321000.489512:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767321000.489518:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292005760:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321000.492791:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292005888:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321000.737064:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321000.801492:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321001.764022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321001.828612:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321002.786587:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321002.852864:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321003.812377:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321003.875006:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321004.833634:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321004.903921:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321005.601262:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321005.601277:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321005.601281:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321005.601285:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321005.601291:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321005.601316:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5905 00000100:00080000:1.0:1767321005.601335:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321005.601345:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321005.601361:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321005.601410:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164292006016/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321005.601479:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767321005.601501:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292006144:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321005.602014:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321005.608639:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292006144:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321005.613637:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321005.613661:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321005.613667:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006016:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321005.857028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321005.922585:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321006.881023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321006.945214:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321007.905047:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321007.971085:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321008.930508:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321008.993898:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321009.953026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321010.017114:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321010.721054:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321010.721069:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321010.721073:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321010.721078:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321010.721105:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321010.721120:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5910 00000100:00080000:1.0:1767321010.721134:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321010.721143:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321010.721160:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321010.721214:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164292006272/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767321010.721548:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767321010.721705:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767321010.721715:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292006400:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321010.725363:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292006400:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767321010.725501:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767321010.725510:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:1.0:1767321010.725515:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006272:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321010.983941:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321011.041298:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321012.001033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321012.065943:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321013.025032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321013.089185:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321014.049126:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321014.114282:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321015.073358:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321015.137541:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767321015.841637:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320990/real 1767320990] req@ffff8c3c58fc2300 x1853164292005120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767321015.841687:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc2300 x1853164292005120/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767321015.841713:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321015.844794:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321015.844811:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767321015.844818:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321015.844832:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5895 00000100:00080000:2.0:1767321015.844847:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321015.844855:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767321015.844924:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164292006528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767321015.844946:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321015.844950:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321015.844952:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321015.844957:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5915 00000100:00080000:2.0:1767321015.844961:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321015.844966:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321015.844979:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321015.844990:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a28ad80 x1853164292006656/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321015.845134:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292006784:192.168.202.133@tcp:400:kworker.0 00000100:00080000:1.0:1767321015.846391:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:1.0:1767321015.846402:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292005120:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767321015.846436:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292006528:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767321015.857431:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006656:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321015.859451:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292006784:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321015.869839:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321015.869859:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321015.869865:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006656:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321016.097031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321016.161135:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321017.121212:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321017.185532:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321018.145024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321018.209423:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321019.169139:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321019.235732:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321020.193077:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321020.263168:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321020.964756:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321020.964770:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321020.964773:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321020.964785:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321020.964792:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321020.964807:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5920 00000100:00080000:1.0:1767321020.964822:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321020.964832:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321020.964847:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321020.964939:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164292006912/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321020.965037:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767321020.965059:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292007040:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321020.966317:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321020.975959:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292007040:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321020.976959:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321020.976974:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321020.976999:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292006912:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321021.217023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321021.289725:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321022.241909:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321022.305818:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321023.265698:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321023.333847:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321024.290062:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321024.354937:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321025.313045:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321025.377229:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767321026.082824:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321026.082839:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767321026.082867:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321026.082911:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321026.082917:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321026.082930:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5925 00000100:00080000:2.0:1767321026.082946:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321026.082956:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321026.082972:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321026.083017:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289c00 x1853164292007168/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321026.083107:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767321026.083130:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292007296:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321026.084156:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321026.087155:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292007296:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321026.087647:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321026.087655:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321026.087660:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007168:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321026.337315:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321026.410334:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321027.361728:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321027.425436:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321028.385153:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321028.449195:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321029.409034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321029.473339:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321030.433164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321030.497290:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321031.201631:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321031.201651:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321031.201654:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321031.201659:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321031.201665:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321031.201681:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5930 00000100:00080000:3.0:1767321031.201696:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321031.201706:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321031.201722:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321031.201776:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2300 x1853164292007424/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321031.201855:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321031.202117:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292007552:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321031.214846:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292007552:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321031.224244:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321031.224268:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321031.224274:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007424:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321031.457050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321031.522449:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321032.481134:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321032.546098:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321033.505164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321033.569290:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321034.529041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321034.594793:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321035.553105:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321035.617174:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321036.322800:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321036.322817:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321036.322820:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321036.322825:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321036.322831:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321036.322846:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5936 00000100:00080000:1.0:1767321036.322860:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321036.322905:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321036.322923:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321036.322973:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164292007680/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321036.323067:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292007808:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321036.323553:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321036.331491:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292007808:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321036.338703:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321036.338726:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321036.338732:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292007680:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321036.579525:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321036.641902:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321037.601032:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321037.666200:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321038.626171:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321038.689239:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321039.655990:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321039.713131:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767321040.417393:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321015/real 1767321015] req@ffff8c3c5a289880 x1853164292006528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767321040.417443:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c5a289880 x1853164292006528/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767321040.417469:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321040.417506:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767321040.417511:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292006528:192.168.202.133@tcp:250:kworker.0 00000100:00080000:3.0:1767321040.417599:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321040.417607:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767321040.417612:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321040.417619:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5920 00000100:00080000:3.0:1767321040.417632:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321040.417642:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:3.0:1767321040.417685:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0380 x1853164292007936/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767321040.417716:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321040.417720:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321040.417721:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321040.417725:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5941 00000100:00080000:3.0:1767321040.417729:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321040.417733:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321040.417747:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321040.417770:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc2a00 x1853164292008064/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321040.417833:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292008192:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321040.418289:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292007936:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767321040.418354:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008064:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321040.422155:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321040.422190:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321040.422198:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008064:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321040.422626:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292008192:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321040.673041:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321040.737429:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321041.697131:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321041.763901:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321042.720985:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321042.785736:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321043.745187:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321043.809145:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321044.769203:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321044.844388:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767321045.537259:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321045.537273:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767321045.537277:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321045.537281:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321045.537287:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321045.537301:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5945 00000100:00080000:2.0:1767321045.537314:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321045.537323:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321045.537337:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321045.537386:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289880 x1853164292008320/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321045.537485:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292008448:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321045.537669:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321045.550058:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292008448:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321045.550338:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321045.550348:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321045.550353:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008320:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321045.793537:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321045.857372:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321046.818702:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321046.882977:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321047.842671:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321047.905104:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321048.865255:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321048.931838:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321049.889042:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321049.958351:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321050.657988:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321050.658003:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321050.658006:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321050.658011:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321050.658016:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321050.658029:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5950 00000100:00080000:1.0:1767321050.658041:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321050.658049:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321050.658061:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321050.658105:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3480 x1853164292008576/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321050.658204:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767321050.658221:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292008704:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321050.658445:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321050.662316:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292008704:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321050.662516:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321050.662543:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321050.662548:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008576:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321050.913078:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321050.977991:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321051.936999:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321052.001225:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321052.961505:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321053.026224:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321053.985013:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321054.049768:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321055.009308:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321055.073290:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321055.779442:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321055.779453:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321055.779456:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321055.779459:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321055.779464:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321055.779473:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5955 00000100:00080000:3.0:1767321055.779485:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321055.779491:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321055.779523:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321055.779712:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0e00 x1853164292008832/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321055.779763:0:2520:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767321055.779774:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292008960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321055.780200:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008832:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321055.785708:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321055.785724:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321055.785729:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292008832:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321055.785898:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292008960:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321056.033100:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321056.099102:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321057.057038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321057.121091:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321058.081099:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321058.145512:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321059.105072:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321059.169308:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321060.129023:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321060.195239:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321060.897007:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321060.897019:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321060.897023:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321060.897028:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321060.897034:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321060.897047:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5960 00000100:00080000:3.0:1767321060.897061:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321060.897069:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321060.897083:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321060.897142:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0a80 x1853164292009088/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321060.897246:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292009216:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321060.897317:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321060.905839:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292009216:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321060.905934:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321060.905942:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321060.905947:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009088:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321061.153028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321061.217314:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321062.177056:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321062.241563:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321063.201427:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321063.265137:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321064.225044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321064.289296:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321065.249025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321065.314250:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321066.017413:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1767321066.017451:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321040/real 1767321040] req@ffff8c3c58fc0380 x1853164292007936/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767321066.017480:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321066.017491:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321066.017498:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1767321066.017504:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c58fc0380 x1853164292007936/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767321066.017512:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321066.017530:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767321066.017533:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5965 00000100:00080000:1.0:1767321066.017551:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321066.017564:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321066.017580:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:2.0:1767321066.017609:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767321066.017616:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292007936:192.168.202.133@tcp:250:kworker.0 00000100:00100000:1.0:1767321066.017638:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1880 x1853164292009344/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321066.017690:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009344:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767321066.017796:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292009472:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321066.025321:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321066.025337:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321066.025343:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009344:192.168.202.133@tcp:38:kworker.0 00000100:00080000:1.0:1767321066.026146:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321066.026159:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767321066.026164:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321066.026174:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5945 00000100:00080000:1.0:1767321066.026186:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321066.026194:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767321066.026241:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab3100 x1853164292009600/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321066.026326:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292009600:192.168.202.133@tcp:250:kworker.0 00000100:00100000:0.0:1767321066.030658:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292009472:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321066.274972:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321066.337352:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321067.297486:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321067.363017:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321068.321031:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321068.385086:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321069.345273:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321069.409308:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321070.369033:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321070.438476:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321071.138783:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321071.138793:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321071.138796:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321071.138799:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321071.138803:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321071.138813:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5970 00000100:00080000:3.0:1767321071.138822:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321071.138829:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321071.138839:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321071.138882:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc3480 x1853164292009728/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321071.138964:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292009856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321071.142214:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292009856:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321071.143868:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009728:192.168.202.133@tcp:38:kworker.0 00000100:00080000:2.0:1767321071.149424:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321071.149459:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321071.149465:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009728:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321071.394055:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321071.457205:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321072.417108:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321072.481102:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321073.441741:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321073.506222:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321074.467966:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321074.530829:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321075.492473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321075.554674:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767321076.257667:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767321076.257684:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767321076.257687:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767321076.257701:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767321076.257708:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767321076.257723:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5976 00000100:00080000:0.0:1767321076.257738:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767321076.257747:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767321076.257763:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767321076.257811:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9ce00 x1853164292009984/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321076.257915:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767321076.257941:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767321076.257958:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292010112:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321076.269376:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292010112:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321076.269818:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321076.269828:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321076.269832:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292009984:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321076.513122:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321076.579148:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321077.537061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321077.602451:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321078.561434:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321078.625271:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321079.585066:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321079.649449:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321080.609043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321080.673361:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767321081.378156:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767321081.378171:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767321081.378174:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767321081.378178:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767321081.378182:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767321081.378198:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5981 00000100:00080000:0.0:1767321081.378216:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767321081.378226:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:0.0:1767321081.378244:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767321081.378296:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c50e9c700 x1853164292010240/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321081.378374:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:0.0:1767321081.378397:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767321081.378426:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292010368:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321081.385336:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292010368:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321081.385446:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321081.385462:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321081.385468:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c50e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010240:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321081.633038:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321081.697537:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321082.657590:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321082.721778:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321083.681028:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321083.745363:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321084.706274:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321084.769166:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321085.729050:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321085.793205:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321086.497299:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321086.497309:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321086.497312:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321086.497315:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321086.497319:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321086.497330:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5986 00000100:00080000:3.0:1767321086.497341:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321086.497348:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321086.497360:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321086.497394:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0000 x1853164292010496/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321086.497471:0:2520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292010624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321086.497911:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010496:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321086.502088:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321086.502102:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321086.502107:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010496:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321086.502776:0:2520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2520:1853164292010624:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321086.754626:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321086.817898:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321087.777079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321087.841160:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321088.801079:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321088.867461:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321089.825026:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321089.889166:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321090.849057:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321090.914106:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767321091.617093:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321066/real 1767321066] req@ffff8c3c46ab3100 x1853164292009600/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321091 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767321091.617127:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab3100 x1853164292009600/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321091 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767321091.617165:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321091.617185:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:2.0:1767321091.617190:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292009600:192.168.202.133@tcp:250:kworker.0 00000100:00080000:1.0:1767321091.618081:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321091.618088:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767321091.618091:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321091.618098:0:84831:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5970 00000100:00080000:1.0:1767321091.618108:0:84831:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321091.618114:0:84831:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:1.0:1767321091.618144:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1180 x1853164292010752/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767321091.618175:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321091.618179:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321091.618181:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321091.618185:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5991 00000100:00080000:1.0:1767321091.618188:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321091.618192:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321091.618211:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321091.618222:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2d80 x1853164292010880/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321091.618307:0:2518:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767321091.618322:0:2518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292011008:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321091.619156:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292010752:192.168.202.133@tcp:250:kworker.0 00000100:00100000:2.0:1767321091.619231:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321091.622425:0:2518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2518:1853164292011008:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321091.623724:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321091.623736:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321091.623741:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292010880:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321091.873474:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321091.938921:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321092.897471:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321092.961435:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321093.925151:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321093.985905:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321094.945970:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321095.011346:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321095.969164:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321096.033943:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321096.737118:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321096.737133:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321096.737137:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321096.737141:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321096.737147:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321096.737161:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 5996 00000100:00080000:3.0:1767321096.737175:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321096.737185:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321096.737201:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321096.737253:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164292011136/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321096.737366:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011264:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321096.738266:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321096.763241:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011264:192.168.202.133@tcp:400:kworker.0 00000100:00080000:3.0:1767321096.765273:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767321096.765289:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:3.0:1767321096.765295:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011136:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321096.993188:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321097.057811:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321098.017926:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321098.082389:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321099.040993:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321099.105110:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321100.065022:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321100.130826:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321101.089084:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321101.166986:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321101.857242:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321101.857252:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321101.857255:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321101.857258:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321101.857262:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321101.857273:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6001 00000100:00080000:3.0:1767321101.857283:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321101.857290:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321101.857301:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321101.857335:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc1f80 x1853164292011392/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321101.857392:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767321101.857407:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011520:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321101.858328:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011392:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321101.863900:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321101.863918:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321101.863923:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011392:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321101.864045:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011520:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321102.113020:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321102.178422:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321103.137179:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321103.202959:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321104.161702:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321104.225198:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321105.185017:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321105.249451:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321106.211612:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321106.274297:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767321106.977082:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321106.977094:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767321106.977097:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767321106.977121:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767321106.977126:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767321106.977137:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6006 00000100:00080000:3.0:1767321106.977148:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767321106.977156:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:3.0:1767321106.977168:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767321106.977202:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c58fc0700 x1853164292011648/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767321106.977277:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0:1767321106.977740:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011648:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321106.985471:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321106.985499:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321106.985504:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011648:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321106.985661:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c58fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292011776:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321107.233044:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321107.297739:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321108.257061:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321108.321246:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321109.281058:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321109.345294:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321110.305076:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321110.372982:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321111.328994:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321111.396677:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321112.098663:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321112.098673:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321112.098676:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321112.098680:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321112.098684:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321112.098694:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6011 00000100:00080000:1.0:1767321112.098704:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321112.098711:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321112.098724:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321112.098780:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab1500 x1853164292011904/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321112.098867:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321112.099864:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767321112.099891:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292012032:192.168.202.133@tcp:400:kworker.0 00000100:00100000:1.0:1767321112.102984:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292012032:192.168.202.133@tcp:400:kworker.0 00000100:00080000:2.0:1767321112.112565:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767321112.112580:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:2.0:1767321112.112605:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292011904:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321112.353149:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321112.418609:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321113.380601:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321113.442063:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321114.401034:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321114.467017:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321115.425025:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321115.489102:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767321116.195050:0:2516:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321091/real 1767321091] req@ffff8c3c46ab1180 x1853164292010752/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767321116.195086:0:2516:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3c46ab1180 x1853164292010752/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 1 dl 1767321116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767321116.195105:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321116.195132:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.133@tcp failed (-110) 00000100:00100000:0.0:1767321116.195136:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292010752:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767321116.195418:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321116.195429:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767321116.195434:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c600bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321116.195444:0:81144:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 192.168.202.133@tcp last attempt 5996 00000100:00080000:2.0:1767321116.195457:0:81144:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321116.195467:0:81144:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8c3c600bf800 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000100:00100000:2.0:1767321116.195516:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289f80 x1853164292012160/t0(0) o250->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767321116.195669:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60611719-01b9-46d2-ac0c-8576fdd7db4f:2516:1853164292012160:192.168.202.133@tcp:250:kworker.0 00000100:00080000:2.0:1767321116.196125:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321116.196131:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321116.196134:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321116.196140:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6016 00000100:00080000:2.0:1767321116.196145:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321116.196151:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321116.196164:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321116.196410:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a288000 x1853164292012288/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767321116.196486:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321116.196899:0:2519:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767321116.196911:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292012416:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321116.211754:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321116.211777:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321116.211784:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012288:192.168.202.133@tcp:38:kworker.0 00000100:00100000:2.0:1767321116.211942:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292012416:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321116.450968:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321116.517175:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321117.473073:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321117.537246:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321118.497173:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321118.561234:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321119.522187:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321119.585412:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321120.545295:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321120.610921:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767321121.313801:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321121.313810:0:81144:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767321121.313812:0:81144:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767321121.313816:0:81144:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767321121.313820:0:81144:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767321121.313830:0:81144:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6021 00000100:00080000:2.0:1767321121.313842:0:81144:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767321121.313849:0:81144:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:2.0:1767321121.313861:0:81144:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767321121.313917:0:81144:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c5a289500 x1853164292012544/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767321121.313996:0:2519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292012672:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321121.314318:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321121.322046:0:2519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2519:1853164292012672:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321121.324978:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321121.324996:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321121.325002:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c5a289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012544:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321121.569453:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321121.633118:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321122.593942:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321122.657155:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321123.617093:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321123.681867:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321124.641473:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321124.706463:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321125.665214:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321125.729784:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321126.435129:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321126.435139:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321126.435142:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321126.435146:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321126.435150:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321126.435160:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6026 00000100:00080000:1.0:1767321126.435171:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321126.435178:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321126.435189:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321126.435238:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2680 x1853164292012800/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321126.435307:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292012928:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321126.435474:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012800:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321126.448625:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292012928:192.168.202.133@tcp:400:kworker.0 00000100:00080000:0.0:1767321126.451862:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321126.451912:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321126.451917:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292012800:192.168.202.133@tcp:38:kworker.0 00000100:00100000:3.0:1767321126.689024:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321126.755905:0:60279:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321127.713366:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321127.777538:0:64002:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321128.737717:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321128.811254:0:63743:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321129.761087:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321129.825556:0:50308:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321130.785048:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321130.851841:0:42098:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767321131.553572:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321131.553587:0:84831:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60611719-01b9-46d2-ac0c-8576fdd7db4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767321131.553591:0:84831:0:(pinger.c:229:ptlrpc_pinger_process_import()) 664a2fe3-3696-4765-9fc9-ccd4c8d5d441->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767321131.553596:0:84831:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767321131.553602:0:84831:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767321131.553616:0:84831:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: connect to NID 192.168.202.133@tcp last attempt 6031 00000100:00080000:1.0:1767321131.553633:0:84831:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767321131.553642:0:84831:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8c3c49ba6000: import ffff8c3c431a6000 using connection 192.168.202.133@tcp/192.168.202.133@tcp 00000008:00100000:1.0:1767321131.553658:0:84831:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767321131.553710:0:84831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3c46ab2300 x1853164292013056/t0(0) o38->lustre-MDT0000-mdc-ffff8c3c49ba6000@192.168.202.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767321131.553816:0:2517:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767321131.553842:0:2517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292013184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:0.0:1767321131.553864:0:2516:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292013056:192.168.202.133@tcp:38:kworker.0 00000100:00080000:0.0:1767321131.565519:0:2516:0:(import.c:65:import_set_state_nolock()) ffff8c3c431a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767321131.565556:0:2516:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.133@tcp failed (-19) 00000100:00100000:0.0:1767321131.565563:0:2516:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2516:1853164292013056:192.168.202.133@tcp:38:kworker.0 00000100:00100000:1.0:1767321131.569599:0:2517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8c3c46ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:664a2fe3-3696-4765-9fc9-ccd4c8d5d441:2517:1853164292013184:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1767321131.809075:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321131.873500:0:63742:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321132.834175:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321132.897494:0:63276:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321133.859043:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:1.0:1767321133.923269:0:63490:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767321134.881354:0:84504:0:(client.c:2690:ptlrpc_set_wait()) set ffff8c3c60c8b600 going to sleep for 0 seconds 00010000:00010000:2.0:1767321134.947088:0:42099:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 47880 lines, 47880 kept, 0 dropped, 0 bad.